-- Logs begin at Wed 2022-07-27 07:45:52 UTC, end at Wed 2022-07-27 09:05:09 UTC. -- Jul 27 08:29:50.552552 dv-cinder-851170-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 08:29:50.561695 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 08:29:50 2022] *** Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: nodename: dv-cinder-851170-2-iscsi Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: machine: x86_64 Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: clock source: unix Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: pcre jit disabled Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: detected number of CPU cores: 4 Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: current working directory: / Jul 27 08:29:50.563701 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: detected binary path: /usr/bin/uwsgi-core Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: your processes number limit is 47680 Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: your memory page size is 4096 bytes Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: detected max file descriptor number: 2048 Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: lock engine: pthread robust mutexes Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: thunder lock: enabled Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 08:29:50.564303 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 08:29:50.604058 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: Python main interpreter initialized at 0x55bd308b39c0 Jul 27 08:29:50.604058 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: python threads support enabled Jul 27 08:29:50.604058 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: your server socket listen backlog is limited to 100 connections Jul 27 08:29:50.604058 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: your mercy for graceful operations on workers is 90 seconds Jul 27 08:29:50.604398 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 08:29:50.604474 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: *** Operational MODE: preforking *** Jul 27 08:29:50.604722 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: *** uWSGI is running in multiple interpreter mode *** Jul 27 08:29:50.604722 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: spawned uWSGI master process (pid: 103733) Jul 27 08:29:50.604913 dv-cinder-851170-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 08:29:50.605483 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: spawned uWSGI worker 1 (pid: 103734, cores: 1) Jul 27 08:29:50.605812 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: spawned uWSGI worker 2 (pid: 103735, cores: 1) Jul 27 08:29:50.606367 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 08:29:51.268134 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:29:51.270676 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:29:52.351948 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:29:52.351948 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: from cryptography.utils import int_from_bytes Jul 27 08:29:52.352542 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:29:52.352542 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: from cryptography.utils import int_from_bytes Jul 27 08:29:52.355057 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:29:52.355057 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: from cryptography.utils import int_from_bytes Jul 27 08:29:52.355485 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:29:52.355485 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: from cryptography.utils import int_from_bytes Jul 27 08:29:54.928330 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:29:54.928996 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:29:54.929102 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:29:54.929362 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:29:54.929747 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:29:54.929836 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:29:54.929916 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:29:54.930041 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.930181 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:29:54.930390 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.930508 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:29:54.930746 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:29:54.930844 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931071 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931159 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931398 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931487 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931707 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.931806 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932032 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932137 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932350 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932437 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932674 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932760 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.932931 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933020 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933243 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933331 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933564 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851170-2-iscsi {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933653 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.933939 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.934621 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.934765 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.934856 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935077 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935190 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851170-2-iscsi {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935397 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935497 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935696 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.935809 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936015 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936118 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936319 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936434 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936742 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.936838 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937249 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937395 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937513 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937623 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937819 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.937941 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938167 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938331 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938487 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938574 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938793 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.938879 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939112 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939247 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939422 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939545 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939731 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.939831 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940044 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940133 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940357 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940451 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851170-2-iscsi {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940684 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940825 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.940997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.941087 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.941334 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.941423 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851170-2-iscsi {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.941698 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.941787 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942011 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942107 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942357 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942449 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942675 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942821 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.942996 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943096 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943301 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943389 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943624 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943720 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.943941 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944030 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944256 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944357 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944572 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944673 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944872 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.944960 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945178 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945265 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945491 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945672 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945810 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.945902 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946113 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946232 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946442 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946540 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946687 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946776 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.946991 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947087 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947311 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947410 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947577 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947665 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947885 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.947984 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948167 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948265 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948414 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948520 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948727 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.948827 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949043 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949133 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949290 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949378 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949638 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949813 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.949964 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950121 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950341 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950448 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950674 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950766 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.950978 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951065 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951282 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951369 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951586 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951682 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951894 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.951990 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952299 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952509 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952604 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952812 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.952899 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953126 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953232 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953448 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953544 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953750 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.953839 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954057 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954182 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954422 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954520 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954720 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.954809 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955026 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955129 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955340 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955435 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955662 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955800 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.955967 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956064 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956274 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956374 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956577 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956666 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956883 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.956971 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957190 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957279 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957498 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957586 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957743 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.957832 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958046 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958135 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958377 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958465 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958689 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958779 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.958991 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959087 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959292 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959379 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959610 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959750 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959891 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.959980 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960195 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960293 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960497 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960585 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960796 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.960884 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961097 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961193 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961400 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961487 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961707 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.961796 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962009 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962106 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962339 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962429 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962645 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962731 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.962951 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963051 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963258 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963347 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963560 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963648 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963865 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.963963 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964168 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964279 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964474 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964562 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964779 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.964877 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965112 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965275 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965420 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965575 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965748 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.965915 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.966415 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.966515 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.966597 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.966826 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.966917 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967153 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967302 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967465 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967563 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967774 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.967872 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968072 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968166 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968378 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968466 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968686 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968788 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.968989 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969079 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969295 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969384 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969598 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969695 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969902 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.969994 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970230 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970321 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970536 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970638 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970837 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.970925 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971140 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971227 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971439 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971533 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971743 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.971831 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972047 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972135 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972352 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972441 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972652 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972741 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.972954 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973048 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973273 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973363 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973581 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973677 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.973891 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.973979 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.974221 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.974315 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.974545 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:29:54.974633 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.974885 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.974987 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975213 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975306 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975535 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975629 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975849 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.975946 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976162 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976257 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976489 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976589 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976799 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.976898 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977109 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977197 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977420 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977518 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977739 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.977835 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978052 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978163 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978393 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978493 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978708 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.978819 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979025 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979115 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979341 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979438 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979652 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979755 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.979970 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.980066 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.980286 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.980375 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.980603 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.981247 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.981434 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.981580 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.981750 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.981840 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982083 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982199 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982452 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982636 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982765 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.982856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983112 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983204 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983458 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983553 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983769 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.983858 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984080 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984177 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984402 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984489 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984718 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.984816 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985027 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985340 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985435 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985651 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985747 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.985965 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986054 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986298 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986393 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986612 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986716 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.986928 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987016 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987242 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987333 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987556 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987659 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987869 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.987957 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988180 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988267 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988493 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988582 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988806 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.988895 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989115 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989203 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989426 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989515 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989730 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.989830 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990032 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990120 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990359 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990453 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990667 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990764 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.990973 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991070 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991279 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991369 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991586 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991674 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991898 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.991996 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992204 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992294 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992518 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992604 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992828 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.992925 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993138 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993228 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993447 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993534 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993752 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.993853 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994063 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994203 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994397 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994497 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994700 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.994799 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995007 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995105 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995320 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995408 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995623 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995720 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.995931 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.996018 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.996237 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997020 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997248 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997407 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997562 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997659 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997751 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997833 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.997992 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998076 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998331 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998422 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998643 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998732 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.998967 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999060 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999278 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999366 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999587 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999696 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999901 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:54.999990 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000229 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000318 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000536 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000633 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000850 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.000939 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001172 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001259 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001487 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001797 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.001887 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002108 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002250 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002435 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002538 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002741 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.002837 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003046 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003136 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003355 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003444 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003659 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003757 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.003961 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004048 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004266 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004355 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004568 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004655 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004874 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.004961 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005182 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005271 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005490 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005577 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005793 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.005889 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006097 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006254 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006427 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006516 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006748 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.006854 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007059 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007148 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007370 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007468 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007676 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.007774 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008022 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008118 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008332 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008439 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008677 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.008775 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009011 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009099 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009323 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009411 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009637 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009738 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.009949 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010037 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010288 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010382 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010606 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010712 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.010918 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011006 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011231 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011318 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011540 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011861 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.011948 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.012213 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.012356 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.012535 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.012775 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.012931 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013091 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013253 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013421 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013596 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013738 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.013929 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014063 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014269 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014400 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014593 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014721 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.014905 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015067 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015221 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015411 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015533 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015735 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.015831 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016063 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016162 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016379 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016469 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016697 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.016792 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017011 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017100 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017328 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017417 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017643 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017741 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.017959 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018049 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018289 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018382 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018608 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018698 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.018912 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019002 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019228 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019318 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019556 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019652 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019890 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.019995 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020201 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020291 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020514 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020612 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020830 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.020928 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021137 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021225 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021447 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021535 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021766 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.021863 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022073 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022194 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022405 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022494 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022715 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.022824 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023027 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023117 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023335 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023424 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023687 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023777 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.023996 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024084 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024310 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024399 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024617 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024706 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.024924 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025012 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025230 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025319 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025541 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025632 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025858 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.025945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026193 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026304 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026507 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026612 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026817 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.026907 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.027131 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.027302 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.027482 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028119 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028300 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028463 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028608 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028742 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028907 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.028998 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029213 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029305 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029519 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029616 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029842 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.029930 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030165 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030256 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030472 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030573 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030790 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.030884 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.031112 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.031408 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.031578 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.031727 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.031817 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032025 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032219 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032335 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032642 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032774 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.032957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.033268 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.033356 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.033578 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.033831 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.033922 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034177 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034285 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034509 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034598 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034830 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.034919 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035139 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035234 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035450 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035548 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035758 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.035853 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036061 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036149 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036370 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036468 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036688 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.036794 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037002 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037255 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037351 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037593 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037741 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.037910 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038000 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038258 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038350 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038574 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038664 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038887 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.038978 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.039202 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.039300 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.039524 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.039615 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.039864 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040092 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040190 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040450 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040552 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040815 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.040906 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041143 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041347 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041470 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041674 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041794 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.041993 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042131 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042344 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042488 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042657 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042883 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.042982 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.043220 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.043366 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044065 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044230 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044375 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044594 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044685 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044906 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.044997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045229 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045333 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045539 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045629 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045855 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.045953 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046199 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046345 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046510 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046620 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046823 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.046937 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.047138 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.047260 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.047571 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.047658 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.047894 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048008 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048222 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048322 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048531 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048653 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048869 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.048965 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049195 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049292 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049508 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049596 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049909 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.049996 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.050242 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.050488 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.050578 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.050869 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.051067 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.051171 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.051467 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.051712 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.051802 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052082 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052283 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052387 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052685 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052901 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.052999 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.053293 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.053495 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.053594 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.053897 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.054177 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.054270 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.054522 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.054776 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.054951 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.055136 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.055362 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.055459 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.055732 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.055995 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.056093 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.056339 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.056600 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.056691 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.056940 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.057192 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.057284 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.057546 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.057709 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.057852 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.058170 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.058282 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.058477 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.058786 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.058909 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059232 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059328 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059569 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059658 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059902 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.059993 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060233 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060332 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060549 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060637 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060858 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.060948 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061171 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061273 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061479 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061567 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061788 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.061876 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062107 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062285 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062445 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062534 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062760 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.062849 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063171 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063377 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063467 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063682 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063773 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.063989 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064089 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064295 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064391 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064606 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064770 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.064929 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065079 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065222 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065360 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065488 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065584 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065808 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.065901 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066132 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066244 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066464 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066554 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066796 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.066888 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067116 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067216 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067449 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067554 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067762 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.067861 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068080 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068259 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068390 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068494 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068699 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.068833 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069015 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069141 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069345 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069444 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069668 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.069757 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070008 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070096 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070351 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070458 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070664 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070753 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.070995 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071094 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071280 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071371 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071588 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071677 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071893 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.071985 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072195 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072283 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072499 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072595 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072820 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.072934 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073129 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073248 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073440 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073576 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073760 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.073891 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074079 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074224 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074425 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074561 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074767 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.074868 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.075081 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.075384 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.075474 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.075691 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.075996 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.076095 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.076302 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.076611 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.076708 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.076921 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.077226 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.077335 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.077533 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.077832 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.077923 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.078161 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.078468 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.078567 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.078776 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.079080 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.079169 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.079403 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.079686 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.079776 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080003 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080292 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080390 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080601 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080878 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.080984 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.081199 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.081472 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.081628 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.081947 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082044 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082286 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082391 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082593 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082683 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.082904 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083003 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083215 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083306 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083532 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083622 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083845 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.083943 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084149 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084261 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084563 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084653 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084873 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.084976 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085183 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085280 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085491 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085588 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085795 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.085885 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086097 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086260 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086430 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086529 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086752 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.086843 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087055 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087154 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087361 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087462 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087661 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087753 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.087976 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088064 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088277 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088381 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088593 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088690 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.088910 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089010 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089227 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089325 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089539 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089628 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089869 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.089986 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.090730 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.090879 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.091407 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.091566 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.091723 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.091814 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092036 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092136 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092355 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092446 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092659 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092746 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.092973 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093102 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093282 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093425 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093606 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093747 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.093929 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094059 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094260 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094403 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094575 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094721 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.094880 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095043 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095202 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095364 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095522 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095675 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.095834 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096100 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096190 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096418 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096551 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096742 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.096873 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097058 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097182 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097375 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097509 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097676 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097814 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.097990 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098101 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098346 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098449 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098657 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098755 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.098966 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099058 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099275 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099364 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099600 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099697 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099901 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.099997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100210 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100308 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100519 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100632 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100827 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.100949 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.101130 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.101259 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.101437 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.101726 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.101879 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.102025 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.102196 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.102370 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.102471 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.102682 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103001 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103089 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103319 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103409 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103624 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103722 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.103944 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104033 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104249 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104344 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104551 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104650 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104854 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.104945 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.105155 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.105244 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.105495 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.105584 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.106390 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.106531 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.106705 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.106810 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107173 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107263 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107509 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107606 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107823 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.107912 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.108158 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.108250 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.108602 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.108700 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.108929 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109028 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109246 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109337 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109574 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109668 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.109906 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110004 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110241 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110336 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110554 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110643 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110869 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.110974 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.111179 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.111283 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.111493 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.111640 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.111955 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.112055 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.112268 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.112359 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.112632 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.112861 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113051 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113292 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113384 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113613 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113702 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.113923 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114022 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114258 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114354 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114588 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114680 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114895 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.114993 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115203 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115293 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115525 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115622 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115839 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.115936 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116166 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116255 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116477 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116567 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116796 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.116893 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117108 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117197 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117417 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117515 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117730 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.117822 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118037 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118134 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118376 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118515 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118694 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.118786 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119009 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119099 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119325 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119415 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119643 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119735 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.119960 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120058 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120271 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120361 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120585 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120684 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120899 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.120989 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.121216 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.121329 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.121707 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.121811 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122025 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122323 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122430 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122653 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122746 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.122961 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123058 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123272 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123362 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123581 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123681 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123894 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.123984 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124199 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124296 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124507 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124597 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124814 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.124912 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125123 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125222 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125440 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125529 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125759 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.125854 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126070 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126184 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126415 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126506 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126725 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.126815 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127032 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127134 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127348 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127438 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127662 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.127758 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128010 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128101 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128325 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128414 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128635 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128744 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.128950 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129043 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129265 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129427 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129579 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129681 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129890 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.129987 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130231 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130324 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130540 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130647 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130853 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.130943 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131165 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131265 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131476 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131580 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131792 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.131894 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132102 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132193 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132419 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132517 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132739 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.132888 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133063 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133154 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133374 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133611 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133702 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.133949 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134039 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134297 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134519 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134612 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134839 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.134930 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135174 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135263 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135501 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135595 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135826 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.135917 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136142 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136244 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136457 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136546 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136771 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.136861 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.137202 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.137309 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.137642 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.137830 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.137914 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138004 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138277 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138388 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138596 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138734 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.138915 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139005 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139227 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139325 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139534 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139634 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139855 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.139946 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.140200 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.140297 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.140536 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.140729 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.140887 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141108 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141212 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141427 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141518 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141752 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.141855 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142080 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142254 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142420 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142522 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142734 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.142824 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143054 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143160 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143359 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143449 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143667 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143758 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.143983 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144074 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144294 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144382 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144599 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144688 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.144902 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145001 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145214 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145304 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145551 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145710 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145874 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.145972 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.146215 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.146423 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.146526 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.146741 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.146834 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147078 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147168 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147415 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147504 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147718 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.147817 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148030 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148141 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148336 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148426 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148654 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148799 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.148947 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149046 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149250 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149349 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149560 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149651 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149864 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.149960 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150185 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150297 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150492 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150581 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150802 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.150899 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151105 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151209 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151413 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151503 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151723 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.151812 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.152129 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.152245 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.152374 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153153 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153306 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153515 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153620 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153848 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.153938 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.154190 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.154283 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.154506 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.154684 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.154818 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155003 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155163 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155335 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155479 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155647 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.155955 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156056 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156277 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156369 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156596 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156686 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156906 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.156996 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157216 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157305 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157533 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157632 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157854 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.157943 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158169 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158262 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158494 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158593 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158804 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.158940 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159116 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159207 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159427 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159520 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159768 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.159863 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160080 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160202 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160422 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160512 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160731 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.160820 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161039 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161137 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161378 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161470 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161720 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.161825 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162030 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162129 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162394 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162487 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162733 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.162827 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163043 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163142 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163360 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163454 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163669 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163759 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.163983 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164074 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164304 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164394 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164621 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164711 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.164932 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165022 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165239 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165328 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165549 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165646 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165858 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.165948 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166194 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166301 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166512 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166602 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166827 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.166927 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.167134 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.167222 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.167486 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.167636 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.167950 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.168047 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.168897 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169031 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169217 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169321 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169550 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169661 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.169918 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170022 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170275 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170386 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170598 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170688 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.170908 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171005 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171222 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171321 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171539 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171630 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171852 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.171949 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172166 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172259 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172484 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172583 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172798 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.172888 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173102 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173192 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173415 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173505 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173724 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.173821 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174033 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174122 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174367 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174468 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174675 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174778 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.174980 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175077 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175289 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175387 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175591 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175688 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175896 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.175993 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176202 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176292 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176507 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176607 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176817 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.176906 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177118 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177207 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177421 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177512 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177722 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.177818 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178025 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178113 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178395 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178493 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178651 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178741 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.178961 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179050 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179263 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179363 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179565 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179654 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.179866 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180002 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180168 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180315 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180469 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180637 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180798 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.180962 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181129 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181275 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181444 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181599 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181767 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.181923 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182077 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182280 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182422 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182609 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182734 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.182923 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.183055 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.183384 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.183526 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.183698 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.184068 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.184166 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.184404 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.184703 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.184804 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185014 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185300 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185392 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185625 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185837 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.185929 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.186255 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.186367 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.186585 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.186799 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.186913 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187137 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187236 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187481 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187578 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187812 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.187902 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188136 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188310 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188461 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188609 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188755 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.188902 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189048 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189200 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189344 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189492 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189670 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.189819 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190076 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190285 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190391 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190665 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190756 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.190984 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.191295 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.191388 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.191611 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.191866 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.191957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.192235 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.192428 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.192556 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.192887 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.192977 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.193221 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.193516 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.193666 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.193849 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.194100 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.194239 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.194537 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.194690 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.194851 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.195197 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.195294 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.195525 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.195790 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.195889 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.196141 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.196259 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.196449 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.196703 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:29:55.196792 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.197207 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.197601 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.197940 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.198312 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.198639 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.198976 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.199302 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.199763 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.200103 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.200436 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.200756 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.201104 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.201426 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.201746 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.202065 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.202415 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.202735 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.203057 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.203392 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.203729 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.204042 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.204379 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.204700 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.205026 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.205350 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.205670 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.206006 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.206349 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.206670 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.206989 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.207314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.207634 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.207959 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.208277 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.208626 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.208951 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.209278 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.209643 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.210008 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.210351 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.210685 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.211019 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.211404 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.211849 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.212208 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.212543 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.212867 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.213185 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.213495 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:29:55.213745 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:29:55.359297 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Registered counter for database nova_api Jul 27 08:29:55.367863 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Registered counter for database nova_api Jul 27 08:29:55.380101 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.386788 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.389858 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.396347 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.444233 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.context [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a22975f3-3279-4eca-bf91-9724b46678bf(cell1) {{(pid=103735) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:29:55.448218 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:29:55.450702 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:29:55.451510 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:29:55.451609 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.context [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a22975f3-3279-4eca-bf91-9724b46678bf(cell1) {{(pid=103734) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:29:55.453504 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:29:55.455527 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Registered counter for database nova_cell0 Jul 27 08:29:55.455619 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:29:55.457104 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:29:55.457887 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:29:55.459898 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_concurrency.lockutils [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:29:55.460966 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Registered counter for database nova_cell1 Jul 27 08:29:55.461868 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Registered counter for database nova_cell0 Jul 27 08:29:55.468194 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Registered counter for database nova_cell1 Jul 27 08:29:55.469250 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.471621 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.475026 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.475218 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.477437 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.484305 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.485766 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.618289 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.628402 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO dbcounter [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Registered counter for database nova_cell0 Jul 27 08:29:55.630428 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO dbcounter [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Registered counter for database nova_cell0 Jul 27 08:29:55.637875 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_db.sqlalchemy.engines [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.641595 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG oslo_db.sqlalchemy.engines [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:29:55.642637 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writer thread running {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:55.646445 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writer thread running {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:29:56.059651 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:29:56.067058 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:29:56.082249 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:29:56.089444 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:29:56.406072 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:29:56.411992 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: WARNING keystonemiddleware.auth_token [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:29:56.417209 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd308b39c0 pid: 103735 (default app) Jul 27 08:29:56.419375 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:29:56.420562 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jul 27 08:29:56.421272 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Jul 27 08:29:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:29:56.431119 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:29:56.436522 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: WARNING keystonemiddleware.auth_token [None req-061ccbbd-4e9f-4586-87e4-afed43349fd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:29:56.441738 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd308b39c0 pid: 103734 (default app) Jul 27 08:31:15.709063 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:15.710072 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 27 08:31:15.710728 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:15.722854 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:15.723726 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell1:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:15.724440 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell0:SELECT=3 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:15.725636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:16.577786 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-6760237e-8009-40fc-8a1a-b18322ed6871 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:16.611086 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-6760237e-8009-40fc-8a1a-b18322ed6871 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893414 Jul 27 08:31:16.611826 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 27 08:31:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:18.859153 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:18.860155 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-77c805d4-f790-4306-95bb-97769d9450a2 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 27 08:31:18.860560 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:19.330408 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-01f0989a-76b2-4bad-b9ee-0e2ae0a81c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:19.352058 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:31:19.352058 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 08:31:19.471996 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-01f0989a-76b2-4bad-b9ee-0e2ae0a81c41 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.605234 Jul 27 08:31:19.472508 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:31:19.486684 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:19.487943 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell0:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:19.488933 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell1:SELECT=3 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:19.489762 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:19.695556 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9224f5ee-e08f-4971-8956-1bdb03cd00a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:19.700920 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:31:19.700920 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:31:19.868915 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9224f5ee-e08f-4971-8956-1bdb03cd00a3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387472 Jul 27 08:31:19.881251 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 27 08:31:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:22.123423 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-01f0989a-76b2-4bad-b9ee-0e2ae0a81c41 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:22.124455 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-01f0989a-76b2-4bad-b9ee-0e2ae0a81c41 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 27 08:31:22.125031 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:22.806172 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-12b668ac-27a5-4b41-8e10-d414563f6c6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:22.825481 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:31:22.825481 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:31:22.910509 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-12b668ac-27a5-4b41-8e10-d414563f6c6c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779499 Jul 27 08:31:22.911292 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:22.923823 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-6001162d-59ff-4bc8-9a79-8e7711d9bcdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:22.926910 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:31:22.926910 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: warnings.warn(msg) Jul 27 08:31:23.012793 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-6001162d-59ff-4bc8-9a79-8e7711d9bcdf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092741 Jul 27 08:31:23.018335 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 27 08:31:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:31:25.231839 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-12b668ac-27a5-4b41-8e10-d414563f6c6c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:25.232841 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-12b668ac-27a5-4b41-8e10-d414563f6c6c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 27 08:31:25.233249 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:25.655889 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-09ebf786-2a6c-4d3c-8ac7-77c6b583ac4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:25.737255 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-09ebf786-2a6c-4d3c-8ac7-77c6b583ac4a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497993 Jul 27 08:31:25.737806 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:31:25.758623 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0bbea7d3-0c1d-4d78-8b63-0077f080fbd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:25.810421 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0bbea7d3-0c1d-4d78-8b63-0077f080fbd4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063479 Jul 27 08:31:25.811280 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 27 08:31:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:31:28.017131 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-09ebf786-2a6c-4d3c-8ac7-77c6b583ac4a admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:28.018160 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-09ebf786-2a6c-4d3c-8ac7-77c6b583ac4a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 27 08:31:28.018571 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:28.456438 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-1f6f93f1-ee15-47b4-8150-b7861536914b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "ram": 2048, "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:28.527783 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-1f6f93f1-ee15-47b4-8150-b7861536914b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503359 Jul 27 08:31:28.528614 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:28.541401 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-31ad905a-64e1-490f-8cc4-3cc69e36c9c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:28.616588 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-31ad905a-64e1-490f-8cc4-3cc69e36c9c7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079632 Jul 27 08:31:28.617321 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 27 08:31:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:31:30.842372 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-1f6f93f1-ee15-47b4-8150-b7861536914b admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:30.843380 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-1f6f93f1-ee15-47b4-8150-b7861536914b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 27 08:31:30.843773 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:31.262721 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:31.337914 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488111 Jul 27 08:31:31.338515 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:31.350674 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-d7fbc999-0845-4b37-8db5-45b054de13c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:31.427937 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-d7fbc999-0845-4b37-8db5-45b054de13c0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080824 Jul 27 08:31:31.428494 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Wed Jul 27 08:31:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:33.617510 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:33.619254 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 27 08:31:33.619532 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:34.026973 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-637dab4f-9e4c-411b-9ac1-f79552542a07 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:34.059611 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-637dab4f-9e4c-411b-9ac1-f79552542a07 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433973 Jul 27 08:31:34.060585 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 27 08:31:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:31:36.343523 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:36.348587 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-d16a583a-ee31-4f32-b843-7b20d3f470d9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jul 27 08:31:36.348587 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:36.748012 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9f2343e6-6f90-47b3-83a5-790688a3a58c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "1", "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:36.799648 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9f2343e6-6f90-47b3-83a5-790688a3a58c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.448493 Jul 27 08:31:36.800232 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:36.812953 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-ee3b3537-9ad6-4b1b-ad7d-2fabbe7c7a95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:36.883883 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-ee3b3537-9ad6-4b1b-ad7d-2fabbe7c7a95 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074706 Jul 27 08:31:36.884654 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 27 08:31:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:39.114571 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9f2343e6-6f90-47b3-83a5-790688a3a58c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:39.115590 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9f2343e6-6f90-47b3-83a5-790688a3a58c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 27 08:31:39.115998 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:39.528115 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b0b89a02-83c0-4610-b6b6-059481235073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "ram": 2048, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:39.634001 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b0b89a02-83c0-4610-b6b6-059481235073 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.511914 Jul 27 08:31:39.634579 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:31:39.646596 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-3c800c67-f019-401e-8070-4e3d06e64a2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:39.739440 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-3c800c67-f019-401e-8070-4e3d06e64a2f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096250 Jul 27 08:31:39.740410 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 27 08:31:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:42.033316 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-b0b89a02-83c0-4610-b6b6-059481235073 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:42.034950 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-b0b89a02-83c0-4610-b6b6-059481235073 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 27 08:31:42.034950 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:42.427738 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-6b1aa3c4-17a1-45fc-acb3-eba8bb6cab29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "ram": 4096}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:42.514266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-6b1aa3c4-17a1-45fc-acb3-eba8bb6cab29 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.472872 Jul 27 08:31:42.514744 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:31:42.526960 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-1d91b300-ecfd-4bc5-9b61-dbe47e22311a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:42.626454 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-1d91b300-ecfd-4bc5-9b61-dbe47e22311a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103570 Jul 27 08:31:42.627097 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 27 08:31:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:31:44.797550 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-6b1aa3c4-17a1-45fc-acb3-eba8bb6cab29 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:44.798608 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-6b1aa3c4-17a1-45fc-acb3-eba8bb6cab29 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 27 08:31:44.799008 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:45.166117 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-11e2acc6-6d78-4782-badf-dba9005f1c61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "id": "4"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:45.250699 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-11e2acc6-6d78-4782-badf-dba9005f1c61 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445914 Jul 27 08:31:45.251292 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:45.263547 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-76838e7f-92cc-4b1c-b403-e0f1c330dbe7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:45.345947 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-76838e7f-92cc-4b1c-b403-e0f1c330dbe7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086312 Jul 27 08:31:45.346764 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 27 08:31:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:31:47.603939 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-11e2acc6-6d78-4782-badf-dba9005f1c61 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:31:47.604965 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-11e2acc6-6d78-4782-badf-dba9005f1c61 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 27 08:31:47.605602 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:31:48.084673 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "disk": 160, "id": "5"}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:48.416224 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.804762 Jul 27 08:31:48.417095 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Wed Jul 27 08:31:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:31:48.429246 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-e7c34620-2a57-434a-8783-ea2e6020122b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:31:48.434680 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:31:48.525563 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-e7c34620-2a57-434a-8783-ea2e6020122b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099849 Jul 27 08:31:48.526489 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Wed Jul 27 08:31:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:32:11.735915 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:11.736928 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 27 08:32:11.737324 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:12.159114 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-4bf561c8-5994-45e6-b69d-eee249ba3538 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:12.178021 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-4bf561c8-5994-45e6-b69d-eee249ba3538 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.434423 Jul 27 08:32:12.179326 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 27 08:32:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:13.273646 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:13.274697 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-79e06148-ab1b-4dbd-8ae2-da381a5028c9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jul 27 08:32:13.275092 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:13.821886 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-f2cdf6b4-d94f-4cb5-95c7-a491bf65983f admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:13.829007 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-f2cdf6b4-d94f-4cb5-95c7-a491bf65983f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-f2cdf6b4-d94f-4cb5-95c7-a491bf65983f admin admin] Request method failure captured: Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Host: 10.222.0.40 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4PgNYk8UdeefLw7j-d9DZ6JJIC8KPoyGFvbBlx_qAOjbG6qYVmqKOJDgq3zh4bU8m8LyZGAsm-xEoIsctg2Dq2j-_p-hCA4_Vxw3xYcWNR-04rt0oF47Zs-NzP3RP7GayOKXVmpybL9tBrY7bnDN5sRiovp3nBEgYd-C1qD5Wb6mLLk Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Role: admin,member,reader Jul 27 08:32:13.832330 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Roles: admin,member,reader Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: method: > Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: exception: Flavor 42 could not be found. Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: action_args: {'id': '42'} Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:13.833997 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:13.837121 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-f2cdf6b4-d94f-4cb5-95c7-a491bf65983f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:13.840385 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-f2cdf6b4-d94f-4cb5-95c7-a491bf65983f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.418644 Jul 27 08:32:13.840385 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 27 08:32:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:13.844543 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-338e9000-0667-4b42-afd7-0aaeee65a116 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:13.848960 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:32:13.870710 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-338e9000-0667-4b42-afd7-0aaeee65a116 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029609 Jul 27 08:32:13.871430 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:32:13.881125 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-4c0f6f8f-f548-4b0a-86a5-397aa13f43f2 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:13.906744 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-4c0f6f8f-f548-4b0a-86a5-397aa13f43f2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029125 Jul 27 08:32:13.907310 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:13.917945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-35d6ea4b-623a-4842-9932-2336e3c61451 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:13.923981 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-35d6ea4b-623a-4842-9932-2336e3c61451 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-35d6ea4b-623a-4842-9932-2336e3c61451 admin admin] Request method failure captured: Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Host: 10.222.0.40 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4PgNYk8UdeefLw7j-d9DZ6JJIC8KPoyGFvbBlx_qAOjbG6qYVmqKOJDgq3zh4bU8m8LyZGAsm-xEoIsctg2Dq2j-_p-hCA4_Vxw3xYcWNR-04rt0oF47Zs-NzP3RP7GayOKXVmpybL9tBrY7bnDN5sRiovp3nBEgYd-C1qD5Wb6mLLk Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Role: admin,member,reader Jul 27 08:32:13.927342 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Roles: admin,member,reader Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: method: > Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: exception: Flavor 42 could not be found. Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: action_args: {'id': '42'} Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:13.928856 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:13.929711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:13.932731 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-35d6ea4b-623a-4842-9932-2336e3c61451 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:13.933936 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-35d6ea4b-623a-4842-9932-2336e3c61451 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014940 Jul 27 08:32:13.933936 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 27 08:32:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 08:32:15.042658 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-4c0f6f8f-f548-4b0a-86a5-397aa13f43f2 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:15.044084 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-4c0f6f8f-f548-4b0a-86a5-397aa13f43f2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 27 08:32:15.044193 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:15.623249 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0fb2430f-aae4-4970-9e94-6f055a85558e admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:15.628687 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-0fb2430f-aae4-4970-9e94-6f055a85558e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0fb2430f-aae4-4970-9e94-6f055a85558e admin admin] Request method failure captured: Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Host: 10.222.0.40 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4PgOP3WjyUqmgHbSw21yPwdfSR5F2i5JtaYcydeItgi7jEWMlTOCgLZaoIcH7EnEhwUZyekOJSd28rL8XWrrkw58FXoyp_ArCa1VuggPxAPSUhK-5sHTUtWg9lIdbPgfbKxLK0CFBzhJCoYx49_HBG9vYjt0kTjs3RORPtratCNzW4Q Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Role: admin,member,reader Jul 27 08:32:15.630205 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Roles: admin,member,reader Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: method: > Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: exception: Flavor 84 could not be found. Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: action_args: {'id': '84'} Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:15.632078 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:15.632874 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.633945 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0fb2430f-aae4-4970-9e94-6f055a85558e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:15.636016 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0fb2430f-aae4-4970-9e94-6f055a85558e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432209 Jul 27 08:32:15.636016 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 27 08:32:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:15.643992 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-83b68d88-d232-44bd-9614-10b69cb6c302 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:15.660574 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-83b68d88-d232-44bd-9614-10b69cb6c302 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022308 Jul 27 08:32:15.661124 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:15.671008 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0ba9a30d-a4b9-439a-8947-da794ad2875a admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:15.687533 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0ba9a30d-a4b9-439a-8947-da794ad2875a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020026 Jul 27 08:32:15.688144 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:15.698634 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-43afe207-7cb3-4ccd-bb75-290fb20170da admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:15.704116 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-43afe207-7cb3-4ccd-bb75-290fb20170da admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-43afe207-7cb3-4ccd-bb75-290fb20170da admin admin] Request method failure captured: Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Host: 10.222.0.40 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4PgOP3WjyUqmgHbSw21yPwdfSR5F2i5JtaYcydeItgi7jEWMlTOCgLZaoIcH7EnEhwUZyekOJSd28rL8XWrrkw58FXoyp_ArCa1VuggPxAPSUhK-5sHTUtWg9lIdbPgfbKxLK0CFBzhJCoYx49_HBG9vYjt0kTjs3RORPtratCNzW4Q Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Role: admin,member,reader Jul 27 08:32:15.705636 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Roles: admin,member,reader Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: method: > Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: exception: Flavor 84 could not be found. Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: action_args: {'id': '84'} Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:15.707041 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:15.707828 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:15.708954 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-43afe207-7cb3-4ccd-bb75-290fb20170da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:15.710579 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-43afe207-7cb3-4ccd-bb75-290fb20170da admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013208 Jul 27 08:32:15.710579 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Jul 27 08:32:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:16.694793 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-0ba9a30d-a4b9-439a-8947-da794ad2875a admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:16.695966 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-0ba9a30d-a4b9-439a-8947-da794ad2875a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Jul 27 08:32:16.696374 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:17.243464 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-949401d7-8dbc-4525-99d9-02bcb1b06b4f admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:17.249379 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.wsgi [None req-949401d7-8dbc-4525-99d9-02bcb1b06b4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-949401d7-8dbc-4525-99d9-02bcb1b06b4f admin admin] Request method failure captured: Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept: application/json Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Accept-Encoding: gzip, deflate Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Connection: keep-alive Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Content-Length: 0 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Host: 10.222.0.40 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Openstack-System-Scope: None Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: User-Agent: python-novaclient Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Auth-Token: gAAAAABi4PgQLkoPMFY382lbTfB9ZvlyJrIR6C1EL7Wk-BemJihsKLD7cB-eeP2ZWXyX2pRtLsYQf-M7cZiAHjWYHMi7E-svVJGodlCCyF8udrBPtregOkTmuNtP-cuM-g4D3i109Mh2PzZjogBKiCrW8XOfnB5wq_FjeVcgPNNLt950MJSkNH0 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Id: None Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Domain-Name: None Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Identity-Status: Confirmed Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Is-Admin-Project: True Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Id: default Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Domain-Name: Default Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Project-Name: admin Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Role: admin,member,reader Jul 27 08:32:17.250913 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Roles: admin,member,reader Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant: admin Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-Tenant-Name: admin Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User: admin Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Id: default Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Domain-Name: Default Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: X-User-Name: admin Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: method: > Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: exception: Flavor 451 could not be found. Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: action_args: {'id': '451'} Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:17.252395 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:17.253201 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.254314 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-949401d7-8dbc-4525-99d9-02bcb1b06b4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:17.255332 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-949401d7-8dbc-4525-99d9-02bcb1b06b4f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415250 Jul 27 08:32:17.255332 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:32:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:17.262627 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-132023d5-b17c-48be-abce-585b61b1477c admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:17.278317 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-132023d5-b17c-48be-abce-585b61b1477c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019052 Jul 27 08:32:17.278870 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:17.289550 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:17.305931 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020978 Jul 27 08:32:17.306596 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Jul 27 08:32:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:32:17.316020 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a41d3098-7d51-44cf-9b8b-2be0bc4d48ed admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:17.321442 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.wsgi [None req-a41d3098-7d51-44cf-9b8b-2be0bc4d48ed admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a41d3098-7d51-44cf-9b8b-2be0bc4d48ed admin admin] Request method failure captured: Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept: application/json Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Accept-Encoding: gzip, deflate Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Connection: keep-alive Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Content-Length: 0 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Host: 10.222.0.40 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-Api-Version: compute 2.90 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Openstack-System-Scope: None Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: User-Agent: python-novaclient Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Auth-Token: gAAAAABi4PgQLkoPMFY382lbTfB9ZvlyJrIR6C1EL7Wk-BemJihsKLD7cB-eeP2ZWXyX2pRtLsYQf-M7cZiAHjWYHMi7E-svVJGodlCCyF8udrBPtregOkTmuNtP-cuM-g4D3i109Mh2PzZjogBKiCrW8XOfnB5wq_FjeVcgPNNLt950MJSkNH0 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Id: None Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Domain-Name: None Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Identity-Status: Confirmed Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Is-Admin-Project: True Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Id: default Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Domain-Name: Default Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Project-Name: admin Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Role: admin,member,reader Jul 27 08:32:17.322957 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Roles: admin,member,reader Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/28a37ee923b244c5bc101a0c6c5cd5d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_28a37ee923b244c5bc101a0c6c5cd5d6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant: admin Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Id: 28a37ee923b244c5bc101a0c6c5cd5d6 Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-Tenant-Name: admin Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User: admin Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Id: default Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Domain-Name: Default Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Id: c247fd0f0c364a67b9e7168fc38f6873 Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: X-User-Name: admin Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: method: > Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: exception: Flavor 451 could not be found. Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: action_args: {'id': '451'} Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:32:17.324266 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:17.325067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: ERROR nova.api.openstack.wsgi Jul 27 08:32:17.326152 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-a41d3098-7d51-44cf-9b8b-2be0bc4d48ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:32:17.327251 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-a41d3098-7d51-44cf-9b8b-2be0bc4d48ed admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011883 Jul 27 08:32:17.327251 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:32:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 08:32:18.335975 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:18.337000 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 27 08:32:18.337501 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:18.873321 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-9c738e40-38f6-4802-9506-3ef911684fb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:32:18.981869 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-9c738e40-38f6-4802-9506-3ef911684fb5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.504158 Jul 27 08:32:18.982458 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 27 08:32:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:32:19.952931 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:19.953935 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 27 08:32:19.954355 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:20.484098 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-075c8c2f-b883-4a40-bb6a-69a318f43043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:32:20.581047 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-075c8c2f-b883-4a40-bb6a-69a318f43043 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.487936 Jul 27 08:32:20.581593 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 27 08:32:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:32:21.547864 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:21.548880 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 27 08:32:21.549525 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:22.074464 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-63904d5c-6787-4d30-b98c-5eeed99bd7ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:32:22.140841 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-63904d5c-6787-4d30-b98c-5eeed99bd7ee admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.449821 Jul 27 08:32:22.141356 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 27 08:32:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:32:23.109447 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:23.110571 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 27 08:32:23.111057 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:23.625932 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-5513a838-ce9b-43a2-87a9-3f0144fb9692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:32:23.717711 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-5513a838-ce9b-43a2-87a9-3f0144fb9692 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.469067 Jul 27 08:32:23.718290 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Jul 27 08:32:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:32:24.688960 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:24.689978 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 08:32:24.690411 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:32:25.208449 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-468ec2ce-9b9f-4dfc-a966-6a078736ddeb admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:32:25.230001 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-468ec2ce-9b9f-4dfc-a966-6a078736ddeb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402047 Jul 27 08:32:25.230563 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Jul 27 08:32:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:33:16.874025 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:16.875068 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-8d095d92-163a-445f-9599-d959b4acb5de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 27 08:33:16.875465 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Wed Jul 27 08:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:33:16.886673 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:17.262699 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-cd0cefb9-e8ad-4a0a-811b-e7ac6fe6d63d admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:17.283459 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-cd0cefb9-e8ad-4a0a-811b-e7ac6fe6d63d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401297 Jul 27 08:33:17.284817 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Wed Jul 27 08:33:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:33:17.306071 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG dbcounter [-] [103734] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103734) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:33:17.309764 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-419e5677-8bb0-4610-bc06-a5e54ac500c1 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:17.317407 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-419e5677-8bb0-4610-bc06-a5e54ac500c1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012722 Jul 27 08:33:17.317936 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Jul 27 08:33:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:33:17.329278 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-08a94721-4326-48af-923a-b62ad63d97c2 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:17.336913 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-08a94721-4326-48af-923a-b62ad63d97c2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011170 Jul 27 08:33:17.337422 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Jul 27 08:33:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:33:17.349291 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:17.357110 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011871 Jul 27 08:33:17.363740 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Wed Jul 27 08:33:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:33:17.369217 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-7d4e5880-c5cb-4790-994e-bec0e7cb6ef8 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:33:17.376790 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-7d4e5880-c5cb-4790-994e-bec0e7cb6ef8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011151 Jul 27 08:33:17.377299 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Wed Jul 27 08:33:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:37:15.135924 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:15.136967 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 27 08:37:15.137361 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:37:15.278659 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=6 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:15.421176 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:15.423819 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:37:15.423819 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:37:15.425067 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:15.425504 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:15.426312 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:15.426741 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:15.462268 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-e0f72713-beb3-4bbe-ab25-3275979a0cee admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.184980 Jul 27 08:37:15.462825 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:37:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:37:16.299861 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:16.300877 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 27 08:37:16.301271 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:37:16.492997 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:16.495975 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:37:16.495975 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:37:16.497166 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:16.497611 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:16.498434 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:16.498864 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:16.519449 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-cfc39583-978c-416e-bb95-2924fa8d3c19 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078986 Jul 27 08:37:16.519939 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:37:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:37:27.766518 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:27.767571 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 27 08:37:27.767971 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:37:27.908525 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell0:SELECT=4 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:27.909246 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_cell1:SELECT=4 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:27.909845 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG dbcounter [-] [103735] Writing DB stats nova_api:SELECT=8 {{(pid=103735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:37:27.957470 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:27.960092 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:37:27.960092 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:37:27.961278 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:27.961723 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:27.962535 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:27.962968 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:27.988412 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-574ce8c2-c6e7-49f3-8c78-4c0bd852a20b admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084205 Jul 27 08:37:27.988959 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:37:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:37:28.808463 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] Calling method '>' {{(pid=103734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:28.809631 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: INFO nova.api.openstack.requestlog [None req-3d8fd0ce-6ce0-4365-b269-9dcbf12dea54 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002241 Jul 27 08:37:28.810031 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: [pid: 103734|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Jul 27 08:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:37:29.001037 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG nova.api.openstack.wsgi [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] Calling method '>' {{(pid=103735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:37:29.003443 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:37:29.003443 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: warnings.warn(msg) Jul 27 08:37:29.004629 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:29.005074 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:29.005891 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:37:29.006363 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: DEBUG oslo_concurrency.lockutils [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:37:29.028046 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: INFO nova.api.openstack.requestlog [None req-d3687ee3-3fa8-4043-bea4-049d9e8778ee admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078094 Jul 27 08:37:29.028592 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: [pid: 103735|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Jul 27 08:37:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:38:28.396453 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: Wed Jul 27 08:38:28 2022 - graceful shutdown triggered... Jul 27 08:38:28.396946 dv-cinder-851170-2-iscsi devstack@n-api.service[103735]: Gracefully killing worker 2 (pid: 103735)... Jul 27 08:38:28.396573 dv-cinder-851170-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 08:38:28.399950 dv-cinder-851170-2-iscsi devstack@n-api.service[103734]: Gracefully killing worker 1 (pid: 103734)... Jul 27 08:38:29.397597 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: worker 1 buried after 1 seconds Jul 27 08:38:29.398073 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: worker 2 buried after 1 seconds Jul 27 08:38:29.398073 dv-cinder-851170-2-iscsi devstack@n-api.service[103733]: goodbye to uWSGI. Jul 27 08:38:29.399232 dv-cinder-851170-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 08:38:29.400339 dv-cinder-851170-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 08:38:29.403235 dv-cinder-851170-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 08:38:29.412598 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 08:38:29 2022] *** Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: nodename: dv-cinder-851170-2-iscsi Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: machine: x86_64 Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: clock source: unix Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: pcre jit disabled Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: detected number of CPU cores: 4 Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: current working directory: / Jul 27 08:38:29.414661 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: detected binary path: /usr/bin/uwsgi-core Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: your processes number limit is 47680 Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: your memory page size is 4096 bytes Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: detected max file descriptor number: 2048 Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: lock engine: pthread robust mutexes Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: thunder lock: enabled Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 08:38:29.415333 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 08:38:29.454563 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: Python main interpreter initialized at 0x5633631049c0 Jul 27 08:38:29.454563 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: python threads support enabled Jul 27 08:38:29.454563 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: your server socket listen backlog is limited to 100 connections Jul 27 08:38:29.454563 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: your mercy for graceful operations on workers is 90 seconds Jul 27 08:38:29.455135 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 08:38:29.455208 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: *** Operational MODE: preforking *** Jul 27 08:38:29.455473 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: *** uWSGI is running in multiple interpreter mode *** Jul 27 08:38:29.455473 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: spawned uWSGI master process (pid: 129908) Jul 27 08:38:29.457951 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: spawned uWSGI worker 1 (pid: 129921, cores: 1) Jul 27 08:38:29.457951 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: spawned uWSGI worker 2 (pid: 129924, cores: 1) Jul 27 08:38:29.457951 dv-cinder-851170-2-iscsi devstack@n-api.service[129908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 08:38:29.455673 dv-cinder-851170-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 08:38:30.130296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:38:30.130909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 08:38:31.280174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:38:31.280174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: from cryptography.utils import int_from_bytes Jul 27 08:38:31.287766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:38:31.287766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: from cryptography.utils import int_from_bytes Jul 27 08:38:31.287907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:38:31.287907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: from cryptography.utils import int_from_bytes Jul 27 08:38:31.287907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:38:31.287907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: from cryptography.utils import int_from_bytes Jul 27 08:38:33.662586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:38:33.663154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:38:33.663370 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:38:33.663736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:38:33.663991 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:38:33.664376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.664698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.665017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.665375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.665697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.666006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.666349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.666665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.666992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.667247 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.667558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.667879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851170-2-iscsi {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.668197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.668667 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.668966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.669288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.669594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.669917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.670255 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.670669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:38:33.671136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.671239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:38:33.671314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.671487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:38:33.671584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.671781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.671899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:38:33.672067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:38:33.672172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.672451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.672561 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.672781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.672952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673269 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673568 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.673887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674561 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851170-2-iscsi {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674710 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.674861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675171 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.675943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851170-2-iscsi {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676416 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.676895 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677202 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677503 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.677983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678341 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.678979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679302 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679454 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.679936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.680090 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.680237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.680390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.680390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.681221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.681547 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.681710 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.681875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682435 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682755 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.682909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851170-2-iscsi {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683390 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.683848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.684921 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685081 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.685989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686179 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.686956 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687416 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.687883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688200 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.688966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689120 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689441 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689749 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.689904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690245 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.690860 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691006 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691006 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691304 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.691853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692315 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692315 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.692892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693200 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693659 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.693948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694618 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694778 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.694939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.695858 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.696016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.696228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.696468 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697107 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697419 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697729 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.697883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.698878 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.699926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700079 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700843 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.700989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701145 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701833 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.701994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702158 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.702937 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703547 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.703991 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.704931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.705976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.706960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707260 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.707866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.708012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.708440 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.708591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.708747 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.708894 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.709058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.709213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.709373 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.709519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.709673 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.709828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.709981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.710135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.710315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.710315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.710602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.710758 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.710924 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.711080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.711234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.711380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.711536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.711691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.711865 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.712128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.712281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.712436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.712651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.712808 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.712955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.713128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.713276 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.713429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.713582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.713730 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.713877 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.714037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.714214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.714368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.714515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.714671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.714826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.714986 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716373 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716613 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.716857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.716930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.717014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.717088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:38:33.717223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717456 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717782 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.717862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.718000 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.718072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.718184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.718284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.718359 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719415 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.719902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720245 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720688 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.720963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721257 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721435 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.721966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722174 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722353 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.722987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723297 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723456 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.723932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724540 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.724857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725003 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.725923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726078 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726447 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726756 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.726920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.727067 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.727220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.727382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.727539 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.727801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728472 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728472 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.728989 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729663 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.729970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730646 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.730939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731259 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.731867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732406 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.732853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733178 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.733943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734427 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.734879 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735182 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735473 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.735922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736359 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.736979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.737905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.738052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.738256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.748548 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.748762 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.748928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.749931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.750907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751345 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751766 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.751944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752192 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752441 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752630 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752808 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.752898 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753145 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753592 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.753862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754403 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.754847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755003 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755137 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755315 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755540 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755778 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.755963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756583 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.756911 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757191 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757264 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757437 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757694 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757778 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757868 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.757961 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758046 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758325 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.758929 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759673 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.759981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760202 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760480 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760905 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.760990 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761172 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761264 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761420 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.761946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762351 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762618 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762808 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.762975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763054 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.763933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764082 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764231 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764852 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.764937 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765021 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765105 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765468 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.765908 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766381 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.766954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.767912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768119 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.768842 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769334 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.769969 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770069 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770320 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770427 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.770943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771427 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.771877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.772868 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773505 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.773972 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.774086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776571 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776679 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.776944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777654 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777745 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.777921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778843 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.778935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779353 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779437 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779667 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.779763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780417 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.780922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781576 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781825 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.781940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.782881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.783905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784040 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784442 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.784973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.785945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.786879 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787185 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787671 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.787975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788447 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788585 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.788901 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789062 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789370 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.789982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790354 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790663 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790798 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.790965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791085 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.791902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792233 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.792942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.793064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.793289 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.793528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.793832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.794218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.794460 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.794610 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.794767 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.794914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795067 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795671 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795824 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.795963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796095 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796395 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796720 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.796887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797189 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797325 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.797927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.798914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799074 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799545 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.799967 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.800932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.801955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.802125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.802285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.802456 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.802593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.802847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803147 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803682 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803816 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.803955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804411 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804556 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.804994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.805165 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.805302 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.805473 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.805619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.806346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.806507 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.806687 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.806836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.806981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807297 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807609 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.807923 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808233 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.808845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809018 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809338 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.809978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810455 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.810931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.811990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812312 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.812936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.813891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.814947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815260 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.815887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816329 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.816963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.817822 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818169 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818798 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.818966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819110 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.819914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820061 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820534 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.820850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.821029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.821180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.821409 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.822893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.823068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.823281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.823401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.823529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.823680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.824002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.824317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.824556 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.824695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.824819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825454 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825774 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.825956 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826411 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826593 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.826906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.827885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.828830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829139 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829755 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.829924 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830512 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.830998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831309 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.831975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832157 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832320 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832472 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832782 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.832933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.833460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.833617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.833769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834009 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834185 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834338 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.834919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.835963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.836113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.836272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.836430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.836665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.836818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837660 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.837908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.838906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839732 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.839971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840582 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.840984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841107 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841286 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.841888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842350 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.842952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843442 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.843905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.844950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845074 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845206 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845540 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.845934 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846518 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.846949 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847271 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847774 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.847895 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848071 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848208 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.848818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849124 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849434 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.849923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850267 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850682 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.850854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.851902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.852853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.853958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854102 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.854847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855192 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855813 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.855994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.856939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.857901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858187 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858309 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.858954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859433 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.859868 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860054 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860763 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.860950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861388 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.861883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862618 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.862936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.863876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.864957 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.865216 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.865442 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.865614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.865844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.866982 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.867150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.867308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.867456 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.867602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.867840 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.868004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.868190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.868875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869339 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.869961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870752 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.870900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871202 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.871961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872435 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872583 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872729 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.872875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.873951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.874125 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.874401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.874560 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.874799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.874962 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.875120 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.875284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.875454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.875674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.875845 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876402 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.876859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.877981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.878942 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879261 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879409 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.879723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880180 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880327 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880476 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.880957 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.881105 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.881392 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.881554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.881713 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.881862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.882979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.883134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.883282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.883438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.883621 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.884586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.884771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885084 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885562 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885798 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.885953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.886367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.886533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.886533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.886814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.886970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.887892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.888891 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.889974 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890320 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.890931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891411 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.891945 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892413 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.892872 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.893999 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.894193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.894348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.894514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.894753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.894914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.895681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.896054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.896203 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.896378 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.896599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.896923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897414 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897731 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.897898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.898289 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.898445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.898594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.898756 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.898914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.899061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.899209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.899372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.899861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900025 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900187 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900810 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.900973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.901978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902137 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902627 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902788 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.902938 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903084 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903535 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.903992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.904150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.904297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.904458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.904613 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.904787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.905803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.906046 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.906287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.906465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.906647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.906881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907496 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907655 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.907953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908283 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908283 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.908984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909132 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909285 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909446 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.909908 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910408 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910576 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.910881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911534 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.911855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912087 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.912872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913021 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913630 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.913936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914270 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.914909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.915178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.915333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.915489 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.915686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.915900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.916085 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.916331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.916487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.916642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.916799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917389 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.917850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918545 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.918934 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919598 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.919912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920514 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920816 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.920979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921302 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921769 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.921924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922512 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922512 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.922970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923613 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.923927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924693 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.924996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.925387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.925387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.925691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.925691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.925987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.926230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.926490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.926657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.926815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.926970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927216 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.927917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.929138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.930291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.931972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.932920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.932920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:38:33.932920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:38:33.985117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO dbcounter [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Registered counter for database nova_api Jul 27 08:38:33.995266 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO dbcounter [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Registered counter for database nova_api Jul 27 08:38:34.006777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.014836 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writer thread running {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.015752 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c54548-845c-47d0-b654-9af056204194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.022851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writer thread running {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.072005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.context [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a22975f3-3279-4eca-bf91-9724b46678bf(cell1) {{(pid=129924) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:38:34.076356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:38:34.077947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:38:34.078845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:38:34.079476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.context [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a22975f3-3279-4eca-bf91-9724b46678bf(cell1) {{(pid=129921) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 08:38:34.081100 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:38:34.083399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO dbcounter [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Registered counter for database nova_cell0 Jul 27 08:38:34.083783 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:38:34.085356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:38:34.086170 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:38:34.087985 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO dbcounter [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Registered counter for database nova_cell1 Jul 27 08:38:34.089240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:38:34.091277 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO dbcounter [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Registered counter for database nova_cell0 Jul 27 08:38:34.095312 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.095479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO dbcounter [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Registered counter for database nova_cell1 Jul 27 08:38:34.097568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.102917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c54548-845c-47d0-b654-9af056204194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.103201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writer thread running {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.104318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c54548-845c-47d0-b654-9af056204194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.105068 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writer thread running {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.110972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writer thread running {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.112261 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writer thread running {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.250239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO dbcounter [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Registered counter for database nova_cell0 Jul 27 08:38:34.256761 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_db.sqlalchemy.engines [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.257154 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO dbcounter [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Registered counter for database nova_cell0 Jul 27 08:38:34.261771 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writer thread running {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.264667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c54548-845c-47d0-b654-9af056204194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:38:34.269081 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writer thread running {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:38:34.578256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: WARNING keystonemiddleware.auth_token [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:38:34.585118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: WARNING keystonemiddleware.auth_token [None req-f2c54548-845c-47d0-b654-9af056204194 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:38:34.585729 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: WARNING keystonemiddleware.auth_token [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:38:34.593033 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: WARNING keystonemiddleware.auth_token [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:38:34.929306 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: WARNING keystonemiddleware.auth_token [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:38:34.935396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: WARNING keystonemiddleware.auth_token [None req-e9b23830-20b8-4d1c-9df9-e04a6278a69d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:38:34.937696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: WARNING keystonemiddleware.auth_token [None req-f2c54548-845c-47d0-b654-9af056204194 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 08:38:34.940724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633631049c0 pid: 129924 (default app) Jul 27 08:38:34.943670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: WARNING keystonemiddleware.auth_token [None req-f2c54548-845c-47d0-b654-9af056204194 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 08:38:34.949526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633631049c0 pid: 129921 (default app) Jul 27 08:39:17.395955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.399354 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.400502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.401395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.461927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.462795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.463776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:17.464506 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:18.480243 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1f382d17-d316-416c-a854-460e51cc115c tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Action: 'create', calling method: .version_select at 0x7f78f2cfd9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1731265977", "metadata": {"Type": "work"}}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:18.806081 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3721d5ff-2a27-417e-8766-092ecf0c67ca tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Action: 'create', calling method: .version_select at 0x7f78f2cfb940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-618979659"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:21.058227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1f382d17-d316-416c-a854-460e51cc115c tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.676548 Jul 27 08:39:21.058808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Jul 27 08:39:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3679 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 08:39:21.074340 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a7c8437b-516f-4bfc-9ee5-e91df5645feb tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b51820>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:21.460490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a7c8437b-516f-4bfc-9ee5-e91df5645feb tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 200 len: 353 microversion: 2.1 time: 0.390948 Jul 27 08:39:21.467516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:21 2022] GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 353 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:21.572264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3721d5ff-2a27-417e-8766-092ecf0c67ca tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.116257 Jul 27 08:39:21.574782 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Jul 27 08:39:17 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4120 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 27 08:39:21.592776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a4c05665-c78e-4fce-a5b6-37d05b328ff1 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b51ee0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:21.734211 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a4c05665-c78e-4fce-a5b6-37d05b328ff1 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 200 len: 344 microversion: 2.1 time: 0.150158 Jul 27 08:39:21.734832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:21 2022] GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:22.475052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-18577ad2-3b54-4173-ab04-e01bb2602298 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b53790>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:22.591345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-18577ad2-3b54-4173-ab04-e01bb2602298 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 200 len: 354 microversion: 2.1 time: 0.120893 Jul 27 08:39:22.605404 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 2/5] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:22 2022] GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:22.606138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-983085a9-d86e-4ffb-b6d2-04352b1c774b tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b69670>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:22.756703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e61891ff-429d-4539-b489-751e6d140cec tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b53ee0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:22.947569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-983085a9-d86e-4ffb-b6d2-04352b1c774b tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 200 len: 354 microversion: 2.1 time: 0.345762 Jul 27 08:39:22.948628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 4/6] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:22 2022] GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 354 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:22.972481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c2012fe5-3c6d-4d55-93c8-9ce1944050f3 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b51c10>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:23.156334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e61891ff-429d-4539-b489-751e6d140cec tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 200 len: 345 microversion: 2.1 time: 0.407639 Jul 27 08:39:23.157095 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:22 2022] GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 345 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:23.170346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a271a3aa-0a12-42cc-8570-d0ffd76900c5 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Action: 'create', calling method: .version_select at 0x7f78f2b6a550>, body: {"snapshot": {"volume_id": "95dc395f-446d-46e1-82b4-c784e4910e82", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-850157562"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:23.286812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c2012fe5-3c6d-4d55-93c8-9ce1944050f3 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 202 len: 0 microversion: 2.1 time: 0.318100 Jul 27 08:39:23.295874 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:39:22 2022] DELETE /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:39:23.299064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f2c63936-a90b-49cf-b706-a8035bb8ce29 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b515e0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:23.637180 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f2c63936-a90b-49cf-b706-a8035bb8ce29 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 200 len: 353 microversion: 2.1 time: 0.344277 Jul 27 08:39:23.638686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 6/9] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:23 2022] GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 353 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:24.072429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a271a3aa-0a12-42cc-8570-d0ffd76900c5 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.906172 Jul 27 08:39:24.073748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 4/10] 10.222.0.40 () {60 vars in 1162 bytes} [Wed Jul 27 08:39:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:39:24.085746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-87c41930-6c8b-47a3-a8ac-1a7ef4aec5bf tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b69430>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:24.160694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-87c41930-6c8b-47a3-a8ac-1a7ef4aec5bf tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.079700 Jul 27 08:39:24.167053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 7/11] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:24 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:24.181356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-332fc316-9455-413e-95f3-981a68ca7873 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b6ae50>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:24.247948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-332fc316-9455-413e-95f3-981a68ca7873 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.079336 Jul 27 08:39:24.248679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Jul 27 08:39:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:24.260947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-af1f82b5-2f05-4278-9641-e1b4f9c31968 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b51820>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:24.319557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-af1f82b5-2f05-4278-9641-e1b4f9c31968 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.062707 Jul 27 08:39:24.321211 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:24 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:24.652760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-22ab3310-8058-45a7-a107-152b5ca61e08 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Calling method '.version_select at 0x7f78f2b53af0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:24.780619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-22ab3310-8058-45a7-a107-152b5ca61e08 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] HTTP exception thrown: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-22ab3310-8058-45a7-a107-152b5ca61e08 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Request method failure captured: Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d HTTP/1.1 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pm18xK53KA8n6c73tiQTXTb6vgx0eYR_EHbxBl3z85oGbz8mRjPyMZezpPt8YMshgMh8_-WaHIxuaWXB77Nilegy9tlhwezikhqNk5RqXcako5-6KrW-FS-WhOYT9l8o9J6kQs_gnPYSHNHQvnrVPQTzGEF0L8DqLjgBV8kAIONrR8 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 173b06cf43cd421eb02bfdfcffcc6a01 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesGetTestJSON-915464864 Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:24.784614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/173b06cf43cd421eb02bfdfcffcc6a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/173b06cf43cd421eb02bfdfcffcc6a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/173b06cf43cd421eb02bfdfcffcc6a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_173b06cf43cd421eb02bfdfcffcc6a01", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesGetTestJSON-915464864 Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 173b06cf43cd421eb02bfdfcffcc6a01 Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesGetTestJSON-915464864 Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesGetTestJSON-915464864-project Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 5fcb4c0e6c60442da43fa46daf41345c Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesGetTestJSON-915464864-project Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'be6f82ae-70e8-4d53-bf7a-7aa8275c792d'} Jul 27 08:39:24.785666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. (HTTP 404) (Request-ID: req-6c5e54e4-dd41-4be7-934f-2226a981c42e) Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:24.786344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:24.787268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:39:24.788198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-22ab3310-8058-45a7-a107-152b5ca61e08 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] Returning 404 to user: Volume be6f82ae-70e8-4d53-bf7a-7aa8275c792d could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-22ab3310-8058-45a7-a107-152b5ca61e08 tempest-VolumesGetTestJSON-915464864 tempest-VolumesGetTestJSON-915464864-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d" status: 404 len: 109 microversion: 2.1 time: 0.137449 Jul 27 08:39:24.790880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 6/14] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:24 2022] GET /compute/v2.1/os-volumes/be6f82ae-70e8-4d53-bf7a-7aa8275c792d => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:25.333023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-bf9a4205-a964-4e1c-a7ab-27ed6a62411b tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2cfddc0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:25.426385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-bf9a4205-a964-4e1c-a7ab-27ed6a62411b tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.096919 Jul 27 08:39:25.426610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 9/15] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:25 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:26.439187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2e666237-8bc3-47f8-88e4-7f1b87a7ed99 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b6a160>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:26.602646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2e666237-8bc3-47f8-88e4-7f1b87a7ed99 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.167656 Jul 27 08:39:26.608662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 7/16] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:26 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:39:27.615515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b9942c1c-e49b-440f-ba0e-b1baf64d09b7 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b69550>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:27.670684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b9942c1c-e49b-440f-ba0e-b1baf64d09b7 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.058958 Jul 27 08:39:27.671638 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 10/17] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:27 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:28.688612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-daef07bb-c079-4a0e-b39e-228bacc400f0 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2ad6700>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:28.784346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-daef07bb-c079-4a0e-b39e-228bacc400f0 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.100217 Jul 27 08:39:28.785671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 8/18] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:28 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:29.798531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-780ab913-f6fc-43a9-9e1d-878bec3f9bab tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b51c10>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:29.888847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-780ab913-f6fc-43a9-9e1d-878bec3f9bab tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.095300 Jul 27 08:39:29.889989 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 11/19] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:29 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:30.598707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-12eaa7cf-e791-4f77-91d0-f7b589cecbc3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: .version_select at 0x7f78f2b53670>, body: {"keypair": {"name": "tempest-keypair-1444867662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrPFYykh/C96aajaFGhL6jYyVOpbaPNZNo5F6qehNsiXB5FQwbkyVQWbRzRp1t1erXHwSjfg24w3KDyQE4LhApo1WI1pAsmr9JfRscoEcdGz5YU1mjcWZQK42jyZ7K1gA=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:30.717765 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-12eaa7cf-e791-4f77-91d0-f7b589cecbc3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:30.739639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-12eaa7cf-e791-4f77-91d0-f7b589cecbc3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for user 26128a80933f4be3bed504d7a2d2785f and project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:30.902298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-44c11e53-31a5-4fc9-a744-29beb82c1413 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b519d0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:30.919409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-12eaa7cf-e791-4f77-91d0-f7b589cecbc3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.013829 Jul 27 08:39:30.924541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 9/20] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Jul 27 08:39:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1016 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 08:39:30.970910 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-44c11e53-31a5-4fc9-a744-29beb82c1413 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 287 microversion: 2.1 time: 0.073801 Jul 27 08:39:30.971644 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 12/21] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:30 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:30.998738 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-39bd9a7e-74fe-47d5-b4a5-65d6ae84a356 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2254430>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:31.250661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-39bd9a7e-74fe-47d5-b4a5-65d6ae84a356 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 202 len: 0 microversion: 2.1 time: 0.256300 Jul 27 08:39:31.251320 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 10/22] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Jul 27 08:39:30 2022] DELETE /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:39:31.260164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2759e808-e975-42e3-9657-ee4d982b454d tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b695e0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:31.325536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2759e808-e975-42e3-9657-ee4d982b454d tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 200 len: 286 microversion: 2.1 time: 0.069613 Jul 27 08:39:31.326109 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:31 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:32.339395 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-18a47907-00ed-4447-b38f-e3398db794e3 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2254af0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:32.416058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-18a47907-00ed-4447-b38f-e3398db794e3 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] HTTP exception thrown: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-18a47907-00ed-4447-b38f-e3398db794e3 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Request method failure captured: Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 HTTP/1.1 Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pm1Oj6hf6vvXU0Qo27CPxlaB0sXWG-3In3CkXKIYUIqzRDZwBS8ir6wybFXvLd6V6RauQKcgGeFR8VzHmZp0HPRgHPquPk4FipeikNPSsHhsAywlMaO1L0yINu_YGQOss1abD8zJDdzyPf89GeDB_mhwdBRyYViGad_9waWddy7asE Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:32.419278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47dc670d30af4db294d3b0a6922e3d8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: fdcd322e1e404105a230cbe7528eb0bc Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'b1e87753-76f8-4777-a38b-845bfc25acf2'} Jul 27 08:39:32.420580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. (HTTP 404) (Request-ID: req-86911005-d947-43a1-956d-4bb6d61f2b55) Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.421245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:32.422640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 08:39:32.423818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. Jul 27 08:39:32.424883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:32.427230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-18a47907-00ed-4447-b38f-e3398db794e3 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Returning 404 to user: Snapshot b1e87753-76f8-4777-a38b-845bfc25acf2 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:32.429566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-18a47907-00ed-4447-b38f-e3398db794e3 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2" status: 404 len: 111 microversion: 2.1 time: 0.093863 Jul 27 08:39:32.448914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-314b347a-83cb-4891-b1b9-63fa8668fafe tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b69dc0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:32.457249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 11/24] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Jul 27 08:39:32 2022] GET /compute/v2.1/os-snapshots/b1e87753-76f8-4777-a38b-845bfc25acf2 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:32.802762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-314b347a-83cb-4891-b1b9-63fa8668fafe tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 202 len: 0 microversion: 2.1 time: 0.367126 Jul 27 08:39:32.813516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:39:32 2022] DELETE /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:39:32.821442 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d957ccf2-5d5b-463d-bbd2-cbca2fa7408a tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2b69040>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:32.972375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d957ccf2-5d5b-463d-bbd2-cbca2fa7408a tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 200 len: 344 microversion: 2.1 time: 0.157559 Jul 27 08:39:32.973327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 15/26] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:32 2022] GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:33.433340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2bf506bb-176a-4191-8df1-9036337b9088 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: .version_select at 0x7f78f2b53a60>, body: {"keypair": {"name": "tempest-keypair-208725782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrAwQfWvc1P2AqaK98QNyWjFahNMt/FsseMYfvkD9/dc7gMNS/vQtWLECebnCSWYgmEp07jask++jUvPhzsB48dp6fXg2ztUHR6KX870PvcpfQgyL6DM2/qk7poSON+3g=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:33.464772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-2bf506bb-176a-4191-8df1-9036337b9088 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:33.469861 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-2bf506bb-176a-4191-8df1-9036337b9088 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for user c29a83c5d2ce48eda587f2cec0e959ce and project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:33.577940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2bf506bb-176a-4191-8df1-9036337b9088 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.836766 Jul 27 08:39:33.578614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 12/27] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:39:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:33.851623 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1132991165", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "networks": [{"uuid": "a1f6320b-3782-410e-b338-e24d3c56438a"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:33.987252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2baaad18-cd91-49ef-a014-2cfb0d304f40 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2268f70>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:34.081878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-2baaad18-cd91-49ef-a014-2cfb0d304f40 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] HTTP exception thrown: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2baaad18-cd91-49ef-a014-2cfb0d304f40 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Request method failure captured: Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 HTTP/1.1 Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pm1Oj6hf6vvXU0Qo27CPxlaB0sXWG-3In3CkXKIYUIqzRDZwBS8ir6wybFXvLd6V6RauQKcgGeFR8VzHmZp0HPRgHPquPk4FipeikNPSsHhsAywlMaO1L0yINu_YGQOss1abD8zJDdzyPf89GeDB_mhwdBRyYViGad_9waWddy7asE Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:34.084416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47dc670d30af4db294d3b0a6922e3d8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: fdcd322e1e404105a230cbe7528eb0bc Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '95dc395f-446d-46e1-82b4-c784e4910e82'} Jul 27 08:39:34.085778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. (HTTP 404) (Request-ID: req-a54c7080-f89b-4b5e-9dcc-de04cb2a870d) Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.086657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:34.087737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:39:34.088867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.089952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.091560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2baaad18-cd91-49ef-a014-2cfb0d304f40 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Returning 404 to user: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:34.092564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2baaad18-cd91-49ef-a014-2cfb0d304f40 tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 404 len: 109 microversion: 2.1 time: 0.109140 Jul 27 08:39:34.097520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 13/28] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:33 2022] GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 08:39:34.103781 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba58da7d-cd88-4c7c-91d4-e657feef430f tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f2268430>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:34.195304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-ba58da7d-cd88-4c7c-91d4-e657feef430f tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] HTTP exception thrown: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba58da7d-cd88-4c7c-91d4-e657feef430f tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Request method failure captured: Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 HTTP/1.1 Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pm1Oj6hf6vvXU0Qo27CPxlaB0sXWG-3In3CkXKIYUIqzRDZwBS8ir6wybFXvLd6V6RauQKcgGeFR8VzHmZp0HPRgHPquPk4FipeikNPSsHhsAywlMaO1L0yINu_YGQOss1abD8zJDdzyPf89GeDB_mhwdBRyYViGad_9waWddy7asE Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:34.197479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47dc670d30af4db294d3b0a6922e3d8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: fdcd322e1e404105a230cbe7528eb0bc Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '95dc395f-446d-46e1-82b4-c784e4910e82'} Jul 27 08:39:34.198838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. (HTTP 404) (Request-ID: req-82dd113d-ae04-4af6-9a9e-680f58cbb7b1) Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.199658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:34.200670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 08:39:34.201809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba58da7d-cd88-4c7c-91d4-e657feef430f tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Returning 404 to user: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:34.203606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ba58da7d-cd88-4c7c-91d4-e657feef430f tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 404 len: 109 microversion: 2.1 time: 0.100163 Jul 27 08:39:34.214281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 14/29] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:39:34 2022] DELETE /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:34.217902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] validate_networks() for [('a1f6320b-3782-410e-b338-e24d3c56438a', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:39:34.226567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8659aeef-5766-4d9a-a41e-71891dfd31db tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Calling method '.version_select at 0x7f78f22689d0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:34.295768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-8659aeef-5766-4d9a-a41e-71891dfd31db tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] HTTP exception thrown: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8659aeef-5766-4d9a-a41e-71891dfd31db tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Request method failure captured: Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 HTTP/1.1 Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pm1Oj6hf6vvXU0Qo27CPxlaB0sXWG-3In3CkXKIYUIqzRDZwBS8ir6wybFXvLd6V6RauQKcgGeFR8VzHmZp0HPRgHPquPk4FipeikNPSsHhsAywlMaO1L0yINu_YGQOss1abD8zJDdzyPf89GeDB_mhwdBRyYViGad_9waWddy7asE Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:34.297638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47dc670d30af4db294d3b0a6922e3d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47dc670d30af4db294d3b0a6922e3d8e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 47dc670d30af4db294d3b0a6922e3d8e Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1787935550 Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: fdcd322e1e404105a230cbe7528eb0bc Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1787935550-project Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '95dc395f-446d-46e1-82b4-c784e4910e82'} Jul 27 08:39:34.298737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. (HTTP 404) (Request-ID: req-a3d11abd-7954-4df9-9ba5-abed7bb8fe49) Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.299366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:34.300279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:39:34.301387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:34.302380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8659aeef-5766-4d9a-a41e-71891dfd31db tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] Returning 404 to user: Volume 95dc395f-446d-46e1-82b4-c784e4910e82 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:34.304519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8659aeef-5766-4d9a-a41e-71891dfd31db tempest-VolumesSnapshotsTestJSON-1787935550 tempest-VolumesSnapshotsTestJSON-1787935550-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82" status: 404 len: 109 microversion: 2.1 time: 0.088950 Jul 27 08:39:34.308291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 15/30] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:34 2022] GET /compute/v2.1/os-volumes/95dc395f-446d-46e1-82b4-c784e4910e82 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:36.502878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2243445-3fc2-4cea-b178-eefc0e375f39 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: .version_select at 0x7f78f2ab2ee0>, body: {"keypair": {"name": "tempest-keypair-1988688965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUe7frM2hfSRYe4aRnfCDszma2trCgUMrhYY6q2gnrGUNo1eWE6dBhqTipEjB27WrffOb2bpCNzvV8UTGoKqYEKJdqpvDW6zSJSW43sPy8+IJMl7EzCR+iBkMPpZIccA=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:36.544682 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-f2243445-3fc2-4cea-b178-eefc0e375f39 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:36.555298 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-f2243445-3fc2-4cea-b178-eefc0e375f39 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:36.665135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2243445-3fc2-4cea-b178-eefc0e375f39 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.306454 Jul 27 08:39:36.667037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 16/31] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:39:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:39:37.269267 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1091159246", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77554b81-fd19-4316-8d69-62980152360c"}], "security_groups": [{"name": "tempest-securitygroup--1212375173"}], "key_name": "tempest-keypair-1444867662", "user_data": "}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:37.777232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:39:37.779458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:39:37.781051 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:39:37.781051 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:39:37.781401 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:39:37.814953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:37.817557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:37.845356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:37.848075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:37.942609 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Getting quotas for project bbedb0ad0538471e98b0641598f08c17. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:37.961126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Getting quotas for user 37554602ef6d461b97660ad6b337ed98 and project bbedb0ad0538471e98b0641598f08c17. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:37.994716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:39:38.004030 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:39:38.073041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] validate_networks() for [('77554b81-fd19-4316-8d69-62980152360c', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:39:38.337136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5f279366-fa0f-43f3-8b46-f76c183b6ad2 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.362462 Jul 27 08:39:38.338180 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 16/32] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 5364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:39:38.353926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3e56b9e6-b221-4e2a-b792-4759baad6f54 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:38.355106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3e56b9e6-b221-4e2a-b792-4759baad6f54 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:38.645703 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3e56b9e6-b221-4e2a-b792-4759baad6f54 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:38.700841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3e56b9e6-b221-4e2a-b792-4759baad6f54 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1215 microversion: 2.1 time: 0.342052 Jul 27 08:39:38.700841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 17/33] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:38 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:39.722130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9fef9aed-ccc4-41a5-b9e8-a0eb5f8c162a tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:39.722953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9fef9aed-ccc4-41a5-b9e8-a0eb5f8c162a tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:39.783699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9fef9aed-ccc4-41a5-b9e8-a0eb5f8c162a tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:39.792509 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9fef9aed-ccc4-41a5-b9e8-a0eb5f8c162a tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1215 microversion: 2.1 time: 0.074893 Jul 27 08:39:39.793362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 18/34] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:39 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:40.018771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:39:40.019308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:39:40.019658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:39:40.020065 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:39:40.020631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:39:40.029447 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:40.029890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:40.030717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:40.031150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:40.054542 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:40.058526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for user 26128a80933f4be3bed504d7a2d2785f and project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:40.070793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:39:40.073766 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:39:40.814360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e026630a-de79-425d-8ba4-47c60b020d36 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:40.814975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e026630a-de79-425d-8ba4-47c60b020d36 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:40.912803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7ab30797-a826-419a-8b9e-3ee61005e298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.649625 Jul 27 08:39:40.917052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 17/35] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Jul 27 08:39:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3654 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 27 08:39:40.931243 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:40.934326 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:41.078075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e026630a-de79-425d-8ba4-47c60b020d36 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:41.092230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e026630a-de79-425d-8ba4-47c60b020d36 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1215 microversion: 2.1 time: 0.277318 Jul 27 08:39:41.106176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 19/36] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:40 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:41.326823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:41.382030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:41.389131 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:41.390787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-58a3f6ee-8be7-4174-906b-9b6f958e331a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1282 microversion: 2.20 time: 0.468592 Jul 27 08:39:41.436162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:40 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1282 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:42.117150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7013387d-bef7-4329-aae5-b2b185fb34b1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:42.118390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7013387d-bef7-4329-aae5-b2b185fb34b1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:42.434672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:42.435412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:42.644762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7013387d-bef7-4329-aae5-b2b185fb34b1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:42.654332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7013387d-bef7-4329-aae5-b2b185fb34b1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1215 microversion: 2.1 time: 0.542503 Jul 27 08:39:42.660424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 20/38] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:42 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1215 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:42.660820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:42.679830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:42.685880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:42.690412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-13078b6d-a006-4719-866b-27a7e40cefb6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1282 microversion: 2.20 time: 0.258500 Jul 27 08:39:42.697217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:42 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:42.757953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1213482799", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86596533-e5bc-41a5-8bd8-3e19070777ca"}], "security_groups": [{"name": "tempest-securitygroup--591057970"}], "key_name": "tempest-keypair-208725782", "user_data": "}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:43.125215 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] validate_networks() for [('86596533-e5bc-41a5-8bd8-3e19070777ca', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:39:43.682254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:43.684714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:43.710549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:43.712168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:43.715676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:43.723238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:43.940664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:39:43.941094 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:39:43.941568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:39:43.941976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:39:43.943282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:39:43.966421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:43.968626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:43.968626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:43.968819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:44.007770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:44.022005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for user c29a83c5d2ce48eda587f2cec0e959ce and project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:44.030317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:44.048724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3b02117c-0023-4dc0-8f3c-d45ba2196a66 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1267 microversion: 2.1 time: 0.371641 Jul 27 08:39:44.050817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:43 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:44.053611 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:39:44.055790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:39:44.062519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:44.063143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:44.076786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:44.077244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:44.078038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:44.078511 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:44.228409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:44.239016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:44.243945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:44.247676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-08bca180-3c3f-4d5e-b41c-5c285a634cd5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1286 microversion: 2.20 time: 0.191533 Jul 27 08:39:44.247764 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8a6ceaf3-4f12-4451-810b-6165769a6e35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.495098 Jul 27 08:39:44.257103 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 21/41] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:39:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:39:44.258969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 21/42] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:44 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:44.294069 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-da21b393-2d99-4ead-b78d-735dc62a9db4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:44.295058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-da21b393-2d99-4ead-b78d-735dc62a9db4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:44.448932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-da21b393-2d99-4ead-b78d-735dc62a9db4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:44.475525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-da21b393-2d99-4ead-b78d-735dc62a9db4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1237 microversion: 2.1 time: 0.214954 Jul 27 08:39:44.477043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:44 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1237 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:44.638187 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5f25e2b0-f4ef-40ae-8f06-ab3f0baaac1f tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Action: 'create', calling method: .version_select at 0x7f78f1a34f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1066156359", "metadata": {"Type": "work"}}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5f25e2b0-f4ef-40ae-8f06-ab3f0baaac1f tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 122 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:39:44.655026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1066156359", "metadata": {"Type": "work"}}} Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: Jul 27 08:39:44.656135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1066156359', 'metadata': {'Type': 'work'}}}} Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise error Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:44.656806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 08:39:44.657896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 08:39:44.658890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 08:39:44.658890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.658890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5f25e2b0-f4ef-40ae-8f06-ab3f0baaac1f tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:44.661042 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5f25e2b0-f4ef-40ae-8f06-ab3f0baaac1f tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.401145 Jul 27 08:39:44.668219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 22/44] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Jul 27 08:39:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:39:44.674523 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce9bffa2-0746-47ee-b9e2-e29e33e0358d tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Action: 'create', calling method: .version_select at 0x7f78f10a2280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1402296082", "metadata": {"Type": "work"}}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce9bffa2-0746-47ee-b9e2-e29e33e0358d tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 120 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:44.686407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1402296082", "metadata": {"Type": "work"}}} Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:44.688039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1402296082', 'metadata': {'Type': 'work'}}}} Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise error Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi '0' Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:44.688717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 08:39:44.690712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 08:39:44.693270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 08:39:44.693270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.695853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce9bffa2-0746-47ee-b9e2-e29e33e0358d tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:44.697948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ce9bffa2-0746-47ee-b9e2-e29e33e0358d tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028725 Jul 27 08:39:44.705852 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 23/45] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Jul 27 08:39:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:39:44.713062 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b6b62962-9a17-4d07-a9f1-ccb05f7ed16e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Action: 'create', calling method: .version_select at 0x7f78f3524c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-732082285", "metadata": {"Type": "work"}}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b6b62962-9a17-4d07-a9f1-ccb05f7ed16e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 118 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:39:44.723958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-732082285", "metadata": {"Type": "work"}}} Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: Jul 27 08:39:44.725607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-732082285', 'metadata': {'Type': 'work'}}}} Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise error Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi '' Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:44.726495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 08:39:44.727818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 08:39:44.728738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 08:39:44.728738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.728738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b6b62962-9a17-4d07-a9f1-ccb05f7ed16e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:44.728738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b6b62962-9a17-4d07-a9f1-ccb05f7ed16e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021719 Jul 27 08:39:44.728738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 23/46] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Jul 27 08:39:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 08:39:44.739011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5c4f2bc3-2698-449b-8d7f-20b53c4b449e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Calling method '.version_select at 0x7f78f22544c0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:44.829944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-5c4f2bc3-2698-449b-8d7f-20b53c4b449e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] HTTP exception thrown: Volume tempest-invalid-1689244575 could not be found. Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5c4f2bc3-2698-449b-8d7f-20b53c4b449e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1689244575 HTTP/1.1 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:44.834067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume tempest-invalid-1689244575 could not be found. Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'tempest-invalid-1689244575'} Jul 27 08:39:44.835391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1689244575 could not be found. (HTTP 404) (Request-ID: req-77b23e21-b108-4015-8203-404e718d0e65) Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.836040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:44.836977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1689244575 could not be found. Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:44.837899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1689244575 could not be found. Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1689244575 could not be found. Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5c4f2bc3-2698-449b-8d7f-20b53c4b449e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 404 to user: Volume tempest-invalid-1689244575 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:44.839066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5c4f2bc3-2698-449b-8d7f-20b53c4b449e tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1689244575" status: 404 len: 99 microversion: 2.1 time: 0.101761 Jul 27 08:39:44.842004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 24/47] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Jul 27 08:39:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1689244575 => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 08:39:44.847188 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fc81d492-e6a9-49a6-b6dd-5a6119a268ab tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005200 Jul 27 08:39:44.847812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 24/48] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Jul 27 08:39:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 27 08:39:44.876675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5436a8a6-7fe4-4efe-87d7-e10393873c09 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006604 Jul 27 08:39:44.877275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 25/49] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Jul 27 08:39:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 08:39:44.887033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-aa6195a2-8211-45db-aee6-016004963366 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Calling method '.version_select at 0x7f78f19d1e50>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:44.936439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-aa6195a2-8211-45db-aee6-016004963366 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] HTTP exception thrown: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-aa6195a2-8211-45db-aee6-016004963366 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/os-volumes/70fa07b4-3436-464d-a1e7-c852d8331ab1 HTTP/1.1 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:39:44.939939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '70fa07b4-3436-464d-a1e7-c852d8331ab1'} Jul 27 08:39:44.947688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. (HTTP 404) (Request-ID: req-70be5440-f320-4477-9d59-b72e72a9d0d5) Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.948526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:39:44.949605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 08:39:44.951258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-aa6195a2-8211-45db-aee6-016004963366 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 404 to user: Volume 70fa07b4-3436-464d-a1e7-c852d8331ab1 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-aa6195a2-8211-45db-aee6-016004963366 tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/70fa07b4-3436-464d-a1e7-c852d8331ab1" status: 404 len: 109 microversion: 2.1 time: 0.058649 Jul 27 08:39:44.952288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 25/50] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:39:44 2022] DELETE /compute/v2.1/os-volumes/70fa07b4-3436-464d-a1e7-c852d8331ab1 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:44.953014 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3a7ce815-1272-4102-a0c4-cddd78e4e7fc tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Calling method '.version_select at 0x7f78f10a2b80>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:45.008084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-3a7ce815-1272-4102-a0c4-cddd78e4e7fc tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] HTTP exception thrown: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3a7ce815-1272-4102-a0c4-cddd78e4e7fc tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Request method failure captured: Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/os-volumes/0e500609-cb34-464f-99bc-df9452de9133 HTTP/1.1 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnP_c4cXvpyPNwA5DnD-61uYvqZdxt29SOKU5G0Vl25ay-mh4OVLWA7PdT_9NQXJ35MtGUKtQKTtwDodvzZzIPJ2B3U7tkAfZxbKFSsgJ1Vzvy3_0sKyDGkrbla3HMeEVwVQiJwZ1EigNCE9rhufvwAFUqcPyrC7OI6v2PSlaor22c Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:39:45.010962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f154fba3c0b846a8aac5d0f1496bf858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f154fba3c0b846a8aac5d0f1496bf858", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: f154fba3c0b846a8aac5d0f1496bf858 Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesNegativeTest-493155134 Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: eac13b5b885f49648f56176349e6c0dc Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesNegativeTest-493155134-project Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '0e500609-cb34-464f-99bc-df9452de9133'} Jul 27 08:39:45.012297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. (HTTP 404) (Request-ID: req-ef5f713b-92c8-4e39-90f6-eb5807302bb3) Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:45.014215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:39:45.015521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:39:45.016665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3a7ce815-1272-4102-a0c4-cddd78e4e7fc tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] Returning 404 to user: Volume 0e500609-cb34-464f-99bc-df9452de9133 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3a7ce815-1272-4102-a0c4-cddd78e4e7fc tempest-VolumesNegativeTest-493155134 tempest-VolumesNegativeTest-493155134-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e500609-cb34-464f-99bc-df9452de9133" status: 404 len: 109 microversion: 2.1 time: 0.065515 Jul 27 08:39:45.017827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 26/51] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:39:44 2022] GET /compute/v2.1/os-volumes/0e500609-cb34-464f-99bc-df9452de9133 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:39:45.073705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:45.074753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:45.083848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.084359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.085916 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.086620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.150026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1545675377", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f6980da-175b-4e92-9032-637e0458eb4f"}], "security_groups": [{"name": "tempest-securitygroup--1962639999"}], "key_name": "tempest-keypair-1988688965", "user_data": "}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:45.314636 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] validate_networks() for [('8f6980da-175b-4e92-9032-637e0458eb4f', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:39:45.478434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:45.503742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6073fda0-64f9-4670-89e4-6cca0fb831e3 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1285 microversion: 2.1 time: 0.434724 Jul 27 08:39:45.505604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 26/52] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:45 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:45.517529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:45.520158 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:45.534861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.541102 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.544029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.545811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.878787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:39:45.880221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:39:45.882088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:39:45.882753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:39:45.883954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:39:45.898358 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.899123 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.900119 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:45.900788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:45.928048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:39:45.936014 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:39:45.951273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:39:45.953447 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:39:46.002398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.016148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.018023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.019196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c85ec3fe-e7c7-4db0-821f-d7895ba15298 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1342 microversion: 2.20 time: 0.512023 Jul 27 08:39:46.020212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 27/53] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:45 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1342 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:46.048931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:46.050176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:46.082236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:46.084192 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:46.085152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:46.088321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:46.184639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8ca9122d-7950-48d3-b3c4-98c5de5b8513 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.039747 Jul 27 08:39:46.211426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 27/54] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:39:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 08:39:46.234077 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a687cf26-0c45-470b-a08e-afb95bde3116 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:46.236955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a687cf26-0c45-470b-a08e-afb95bde3116 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:46.371732 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a687cf26-0c45-470b-a08e-afb95bde3116 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.384918 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a687cf26-0c45-470b-a08e-afb95bde3116 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1242 microversion: 2.1 time: 0.171041 Jul 27 08:39:46.401732 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 28/55] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:46 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:46.422198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.440239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fe5ef2e8-f0fb-4777-9eaf-5cad808952c1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1241 microversion: 2.1 time: 0.404902 Jul 27 08:39:46.446725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 28/56] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:46 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1241 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:46.538128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:46.539906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:46.552794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:46.553336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:46.554474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:46.555098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:46.629257 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:46.637974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-913d422f-7282-4541-9590-3ccadf9965e7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1273 microversion: 2.1 time: 0.107392 Jul 27 08:39:46.638703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 29/57] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:46 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:47.045254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:47.052330 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:47.055889 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.056397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.057166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.057597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.312000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:47.330452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:47.334628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:47.340520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-875b8b70-d1d0-42bd-9b36-d2d492ced503 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1340 microversion: 2.20 time: 0.298652 Jul 27 08:39:47.358833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 29/58] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:47 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1340 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:47.424964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b7683f25-b6d2-4435-b1c6-c5e8c3deece7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:47.424964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b7683f25-b6d2-4435-b1c6-c5e8c3deece7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:47.461917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:47.462789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:47.482759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.488386 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.491534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.492001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.633471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b7683f25-b6d2-4435-b1c6-c5e8c3deece7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:47.642199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b7683f25-b6d2-4435-b1c6-c5e8c3deece7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1242 microversion: 2.1 time: 0.228030 Jul 27 08:39:47.649642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 30/59] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:47 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:47.668969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:47.674518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:47.681785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:47.695706 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.698076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.699127 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:47.701086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:47.833045 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:47.849434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-eb98cd28-345d-4edb-841d-7495a4ff58b8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1289 microversion: 2.1 time: 0.391673 Jul 27 08:39:47.850123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 30/60] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:47 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1289 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:48.097756 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:48.111272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2c38a105-5585-47aa-82a5-138a45caa796 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.454924 Jul 27 08:39:48.125907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:47 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:48.384176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:48.385566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:48.402048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.402578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:48.408160 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.409839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:48.668614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:48.669230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:48.698228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.698657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:48.702799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.703398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:48.844532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:48.862316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:48.869704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:48.879428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-bb714af6-dcc1-40f4-bfed-668dcfb29414 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.498950 Jul 27 08:39:48.909138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 31/62] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:48 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:48.919748 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:48.919899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:48.920452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:48.928385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e75b92c4-35f0-4e13-b31d-b9039aac20d6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1238 microversion: 2.1 time: 0.263588 Jul 27 08:39:48.929144 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 32/63] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:48 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:48.936481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.936881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:48.937662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:48.938306 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.022821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:49.031797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5cd69441-5a7f-4e69-9619-28e7954855ea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1307 microversion: 2.1 time: 0.124353 Jul 27 08:39:49.038694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 32/64] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:48 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:49.133401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:49.134225 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:49.140495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.141026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.142018 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.142581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.346613 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:49.369265 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e25a92d2-9bff-4c39-ab8d-8a85446bc459 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.234673 Jul 27 08:39:49.371775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 33/65] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:49 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:49.917811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:49.918837 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:49.935818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.938903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.939719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.940192 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.956356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:49.959873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:49.969865 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.970640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:49.972834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:49.973600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:50.181156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:50.195487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8cb53129-c131-44c1-8c7b-7a4df453e99a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1294 microversion: 2.1 time: 0.246485 Jul 27 08:39:50.209987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:49 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:50.222879 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:50.233722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:50.258245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:50.258245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:50.258245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:50.258245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:50.380476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:50.406441 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-aeed409f-5c35-4ec9-9562-2375727c13b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1295 microversion: 2.1 time: 0.205242 Jul 27 08:39:50.424533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 35/67] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:50 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1295 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:50.431691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:50.434246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:50.443653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:50.444377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:50.445329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:50.445920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:51.180037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.183809 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.203686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.211643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f99a0598-a90e-40e1-8908-a6395cbd6136 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.784429 Jul 27 08:39:51.214970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 36/68] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:50 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:51.220171 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.231686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a2a04853-3f44-495e-9c73-fb39b35c1dca tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 1.318120 Jul 27 08:39:51.235981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 33/69] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:49 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:51.236112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:51.236112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:51.245501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:51.254404 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:51.255878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:51.256475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:51.430224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:51.431382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:51.435746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.443405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:51.446048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-65d9368e-aec6-4e8c-abc5-46d270d28f08 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1300 microversion: 2.1 time: 0.229220 Jul 27 08:39:51.447163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 37/70] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:51 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:51.462735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:51.463941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:51.464603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:51.592051 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:51.606479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7b9f42a5-9078-45f2-a879-19ae5f28d56b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1295 microversion: 2.1 time: 0.181170 Jul 27 08:39:51.607075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 34/71] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:51 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:52.232872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:52.233488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:52.258903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:52.259508 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:52.265532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:52.265964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:52.283574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:52.284090 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:52.284881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:52.285248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:52.291940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:52.291940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:52.983776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.009624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0c9fd934-6a01-47de-ae49-b15ac23c89df tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.766716 Jul 27 08:39:53.009624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 38/72] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:52 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:53.013554 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:53.023054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:53.041965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.042806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.043995 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.044683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.136913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.154051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a61b191d-0f1c-4c6a-adca-b1727dd3e0d9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1300 microversion: 2.1 time: 0.144150 Jul 27 08:39:53.154884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 39/73] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:53 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:53.174525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.178066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:53.178921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:53.184586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.185478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.188446 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-59bc7d03-17c0-45cd-b539-94e2e1be65d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.931814 Jul 27 08:39:53.189357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 35/74] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:52 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:39:53.193237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.194186 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.196300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.197178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.499586 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:53.524470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a10f16f9-ad7a-44c6-884c-657eecf0283a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.349765 Jul 27 08:39:53.539492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 40/75] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:53 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:53.717701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-da384bcd-2cdc-401c-9406-87cb66f9fca1 req-d6440036-c6f4-49bd-a829-083ae8e85170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10fdcb61-b888-4d03-a3f2-e398132cfc27", "tag": "74a7aaef-2da9-4a35-9f8f-3a48630457ec"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:53.758858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-da384bcd-2cdc-401c-9406-87cb66f9fca1 req-d6440036-c6f4-49bd-a829-083ae8e85170 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.759305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-da384bcd-2cdc-401c-9406-87cb66f9fca1 req-d6440036-c6f4-49bd-a829-083ae8e85170 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.820697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-da384bcd-2cdc-401c-9406-87cb66f9fca1 req-d6440036-c6f4-49bd-a829-083ae8e85170 service nova] Creating event network-changed:74a7aaef-2da9-4a35-9f8f-3a48630457ec for instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 on hv-cinder-85117 Jul 27 08:39:53.823107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-da384bcd-2cdc-401c-9406-87cb66f9fca1 req-d6440036-c6f4-49bd-a829-083ae8e85170 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 08:39:53.825614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.825985 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.826811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:53.827238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:53.875337 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.compute.rpcapi [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 08:39:53.876241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] Releasing lock "compute-rpcapi-router" {{(pid=129924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 08:39:53.920994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0f5bb25c-2917-4f9e-8c6d-21ff0401ba99 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.701407 Jul 27 08:39:53.928752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 36/76] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:54.018048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:54.023027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:54.049947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.050503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.051470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.052050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.177593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=20 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:54.184440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:54.185483 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:54.214652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.216754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.219337 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.219824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.486900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:54.529490 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7b5ffc0a-355b-4fb1-8c1f-b0c38cdbb6a6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.489403 Jul 27 08:39:54.533757 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 41/77] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:54 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:54.550619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:54.552622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:54.573841 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.575068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.576454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:54.577270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:54.858863 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:54.868798 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:54.870954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:54.872304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e206a85c-2b98-42cf-9985-e165c7da9859 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.337271 Jul 27 08:39:54.877745 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 42/78] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:54 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:55.425146 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-5d0ddb1e-fffc-4f95-b7d1-bb5805e91f5e req-0311c485-253e-4bbf-9969-d19fb1f93629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:55.443819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-5d0ddb1e-fffc-4f95-b7d1-bb5805e91f5e req-0311c485-253e-4bbf-9969-d19fb1f93629 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.444737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-5d0ddb1e-fffc-4f95-b7d1-bb5805e91f5e req-0311c485-253e-4bbf-9969-d19fb1f93629 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.473792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-5d0ddb1e-fffc-4f95-b7d1-bb5805e91f5e req-0311c485-253e-4bbf-9969-d19fb1f93629 service nova] Creating event network-changed:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:39:55.477596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-5d0ddb1e-fffc-4f95-b7d1-bb5805e91f5e req-0311c485-253e-4bbf-9969-d19fb1f93629 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 08:39:55.477596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.477596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.477596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.477596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.487234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.compute.rpcapi [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 08:39:55.487531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] Releasing lock "compute-rpcapi-router" {{(pid=129921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 08:39:55.516787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-54be08e9-5071-40d7-8786-9bb6b3c3d6fc None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.637054 Jul 27 08:39:55.517595 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 43/79] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:55.528486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:55.538619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:55.540783 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:55.557065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-81c73421-d992-4c1b-b105-8a50c2ab09be tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 1.381332 Jul 27 08:39:55.558311 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 37/80] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:54 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:55.563551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:55.570312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.570312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.570940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.571382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.576534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:55.596775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:55.619130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.619612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:55.623826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:55.625891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:56.187599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:56.200485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-cfd12abf-f1fe-4c63-af89-943862b8477d tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.640641 Jul 27 08:39:56.201358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 38/81] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:55 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:56.220167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:56.226469 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:56.242464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:56.243271 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:56.245604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:56.251190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:56.377476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:56.391012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3d99ae30-c715-4358-900a-aa0711e621fb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.868103 Jul 27 08:39:56.405444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 44/82] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:55 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:56.866906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:56.866906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:56.866906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:56.866906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.007963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.007963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.009426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.009426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.018993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.018993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-afd00afd-d484-4b64-8127-1fe3eade8f68 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.534134 Jul 27 08:39:57.018993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 39/83] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:56 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:57.021156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.021156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-09871bc6-00c2-49ed-801a-01f828cc5982 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.297727 Jul 27 08:39:57.021156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 45/84] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:56 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:57.231901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:57.232626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:57.251573 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.252996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.255946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.256650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.419497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:57.420549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:57.438462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.438911 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.439726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.444317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.642644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=34 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:57.719239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.732487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-70124dea-369d-4632-ad8b-19ac543e2ebc tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.318181 Jul 27 08:39:57.733952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 46/85] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:57 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:39:57.758355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-e60cd069-f244-4dc9-a9a1-a84c0dc853a0 req-5b8360b5-bddb-4799-a612-545bcca1418a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7739cba-0102-4d24-ac1e-904912fe2c65", "tag": "535f88dd-47a5-428c-ab18-ca28f688244a"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:57.795133 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-e60cd069-f244-4dc9-a9a1-a84c0dc853a0 req-5b8360b5-bddb-4799-a612-545bcca1418a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.797316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-e60cd069-f244-4dc9-a9a1-a84c0dc853a0 req-5b8360b5-bddb-4799-a612-545bcca1418a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.824535 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-e60cd069-f244-4dc9-a9a1-a84c0dc853a0 req-5b8360b5-bddb-4799-a612-545bcca1418a service nova] Creating event network-changed:535f88dd-47a5-428c-ab18-ca28f688244a for instance f7739cba-0102-4d24-ac1e-904912fe2c65 on hv-cinder-85117 Jul 27 08:39:57.836521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-e60cd069-f244-4dc9-a9a1-a84c0dc853a0 req-5b8360b5-bddb-4799-a612-545bcca1418a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099187 Jul 27 08:39:57.839104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 47/86] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:57.855210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:57.856310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:57.865109 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.865767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.866734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:57.867316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:57.963524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:57.972418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e2d0367d-960a-441a-9dc6-ef50acd28b33 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.749245 Jul 27 08:39:57.986172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 40/87] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:57 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:57.998315 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:58.005704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:58.021407 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:58.022700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:58.023725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:58.026227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:58.155952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:58.171786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:58.171786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:58.171786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fbae5272-499e-4c60-8684-7597f5ac60bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.329317 Jul 27 08:39:58.172273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 48/88] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:57 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:39:58.730901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:58.744673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-47e39008-257e-41e8-867a-ee52d7013347 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.748191 Jul 27 08:39:58.746528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 41/89] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:57 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:58.760110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:58.760974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:58.767463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:58.771767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:58.771767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:58.771767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:58.997357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:58.997975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:59.009241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.016367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.017307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.017793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.033622 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:39:59.040368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.059358 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-44cde40d-10d9-48da-a5a5-f4c82c22f7b2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.303617 Jul 27 08:39:59.060035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 49/90] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:58 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:59.196665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:59.197394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:59.226969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.227551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.235261 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.236085 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.377974 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.391235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-21ae453c-6962-467b-b318-11f729bb0d25 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.395079 Jul 27 08:39:59.392104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 42/91] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:58 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:39:59.499238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.516510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.520794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.522887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-25324aa2-5f70-4563-b2ea-84897807523a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.332587 Jul 27 08:39:59.524366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 50/92] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:39:59 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:39:59.760907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:39:59.761774 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:39:59.776384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.776824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.777586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.778010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.896869 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-da4dfce4-1f73-46f2-bded-5a464fdf200c req-e75dc39c-b5e1-4175-8239-17e991cf8eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1df927-86a0-4ed5-aad6-b45dd817b46e", "tag": "55ebce99-8df7-4923-ac6f-3bba997bb3ff"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:39:59.919799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-da4dfce4-1f73-46f2-bded-5a464fdf200c req-e75dc39c-b5e1-4175-8239-17e991cf8eec service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:39:59.920541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-da4dfce4-1f73-46f2-bded-5a464fdf200c req-e75dc39c-b5e1-4175-8239-17e991cf8eec service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:39:59.936757 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-da4dfce4-1f73-46f2-bded-5a464fdf200c req-e75dc39c-b5e1-4175-8239-17e991cf8eec service nova] Creating event network-changed:55ebce99-8df7-4923-ac6f-3bba997bb3ff for instance ba1df927-86a0-4ed5-aad6-b45dd817b46e on hv-cinder-85117 Jul 27 08:39:59.945012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-da4dfce4-1f73-46f2-bded-5a464fdf200c req-e75dc39c-b5e1-4175-8239-17e991cf8eec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052336 Jul 27 08:39:59.947989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 51/93] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:39:59.977327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:39:59.993954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3c47c628-671e-4b02-86ea-136f4bec5bd6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.236531 Jul 27 08:40:00.016358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 43/94] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:39:59 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:00.088071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:00.088071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:00.095276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.095839 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.096828 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.097398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.270202 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:00.278115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ebad0935-c2f4-44ed-8e66-67242155e599 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.196959 Jul 27 08:40:00.278769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 52/95] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:00 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:00.413019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:00.413719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:00.415681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:00.420484 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.420997 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.421792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.422237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.546945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:00.547408 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:00.554744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.555194 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.555966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:00.556401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:00.612086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:00.621471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b4ae3f7a-8469-4dd2-a486-b56f1f83b91c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.212964 Jul 27 08:40:00.625089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 44/96] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:00 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:00.725499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:00.736389 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:00.738721 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:00.740391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-05ef3308-0a87-4145-8572-5efcebdc681d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.197437 Jul 27 08:40:00.755354 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 53/97] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:00 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:40:01.016902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:01.017509 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:01.023468 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.023915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.024675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.025104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.205616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.214571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-35bd2da2-0a6b-4b86-a42b-f1b1c10ec51f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.201445 Jul 27 08:40:01.215429 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 45/98] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:01 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:01.301386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:01.302408 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:01.308758 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.309393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.310301 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.310809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.460393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.468110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bb69aa94-d758-460b-9022-e64c2943ef95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.171666 Jul 27 08:40:01.469055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 54/99] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:01 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:01.642546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:01.643154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:01.655290 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.658603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.658603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.658603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.766937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:01.768086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:01.776739 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.779584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.780589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:01.781337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:01.845197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.855018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-862dcb20-adf2-4886-9a77-80fe2391896f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.216146 Jul 27 08:40:01.855206 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 46/100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:01 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:01.968385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.977010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.988066 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:01.989376 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-431ccd0d-d637-4972-9e9d-df7611633411 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.228624 Jul 27 08:40:01.990032 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 55/101] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:01 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:02.243738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:02.245272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:02.267152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.267747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:02.268633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.272844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:02.444541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:02.453522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-804b6405-852f-483f-86dc-04e6216542ff tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.222263 Jul 27 08:40:02.454161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 47/102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:02 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:02.491270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:02.491994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:02.499334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.499334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:02.500303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.500829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:02.659509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:02.668616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3bf42963-4ca1-43ce-b02f-fd3fb38686f4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.182247 Jul 27 08:40:02.670265 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 56/103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:02 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:02.875628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:02.876246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:02.883678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.884301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:02.885384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:02.885978 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.012005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:03.012634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:03.018820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.019504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.020491 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.021438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.021656 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.029445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e9ac0ec7-320d-427a-a10f-7a74855d3b58 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.158041 Jul 27 08:40:03.042170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 48/104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:02 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:03.192829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.202682 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.206873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.206873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-83e69223-90be-4224-9c71-0bfb4391c869 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.198579 Jul 27 08:40:03.207415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 57/105] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:03 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:40:03.478790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:03.479782 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:03.486316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.486759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.487514 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.487943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.627823 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.635401 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-392a8cd9-94ba-4886-a6fe-d56bf8d0c53a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.160864 Jul 27 08:40:03.636168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 49/106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:03 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:03.690718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:03.691764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:03.697806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.698198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.698956 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:03.699381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:03.862573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:03.873676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-42183d22-065c-4cae-b1e1-c6f0bc37b6ee tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.186798 Jul 27 08:40:03.883031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 58/107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:03 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:04.053629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:04.054269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:04.056292 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:04.061210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.061662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.062459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.062919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.195656 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:04.203181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ba85a9b2-44d1-4aa6-a936-08b6cf689844 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.154108 Jul 27 08:40:04.203766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 50/108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:04 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:04.232522 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:04.232522 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:04.235970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.236459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.237218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.237644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.396726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:04.413393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:04.414963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:04.418850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1d497d9b-cf5d-4e39-9a18-99d59c23f4e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.193769 Jul 27 08:40:04.419424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 59/109] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:04 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:40:04.656873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:04.657858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:04.664970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.665625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.666563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.667141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.817840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:04.825582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-de0b4b27-1987-45ed-a659-50c48a04f1b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.172535 Jul 27 08:40:04.826161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 51/110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:04 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:04.896221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:04.896900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:04.902965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.903414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:04.904177 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:04.904777 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.051529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:05.059992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1bfb300a-d2c8-40ea-b372-78342612dc23 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.168530 Jul 27 08:40:05.060497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 60/111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:04 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:05.225138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:05.225785 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:05.232004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.237056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.237056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.237056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.373702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:05.381624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b4d7bc1f-5625-4f5c-a715-fed2b2656cbf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.161004 Jul 27 08:40:05.382218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 52/112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:05 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:05.448021 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:05.449578 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:05.459427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.460293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.461584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.462316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.499052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:05.639854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:05.651277 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:05.655022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:05.657227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-68d09e4e-db32-48e2-b3db-de09a98049dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.213773 Jul 27 08:40:05.658417 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 61/113] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:05 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:05.850046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:05.851150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:05.858178 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.858651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:05.859428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:05.859870 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.068341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.081170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f3231b6b-17c3-4a07-8e23-f52970413145 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.237426 Jul 27 08:40:06.081685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:06.083150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:06.100677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.101022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 53/114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:05 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:06.101588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.103041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.103673 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.131796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:06.273851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.285427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-63ac3067-9dbd-46ae-97ce-9dcdc7238d9c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.208129 Jul 27 08:40:06.286516 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 62/115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:06 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:06.405323 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:06.406132 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:06.412619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.413195 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.414021 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.414489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.555960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.570212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e7c34f51-1e61-4f34-b4e8-27c792d867ba tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.169597 Jul 27 08:40:06.570940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 54/116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:06 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:06.684390 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:06.685084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:06.691493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.693934 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.693934 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:06.693934 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:06.856499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.863913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.865423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:06.866561 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1cfaaad9-9351-49fe-8389-943ce76c042f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.186090 Jul 27 08:40:06.867116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 63/117] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:06 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:07.112665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:07.113303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:07.119370 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.119883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.120730 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.121154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.279598 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:07.288135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6971a5d4-ff6b-4c36-ae0c-3b2dde1ddf76 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.179259 Jul 27 08:40:07.288721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 55/118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:07 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:07.308716 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:07.310022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:07.322608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.325162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.326168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.327254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.537822 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:07.557216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d00e7415-d9b8-47df-b9d3-e17780a8e983 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.252244 Jul 27 08:40:07.570646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 64/119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:07 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:07.593441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:07.594988 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:07.606614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.607222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.608147 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.608752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.818724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:07.829939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3343a53a-6b26-4797-9d4d-ff17ef2ecadd tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.236951 Jul 27 08:40:07.838583 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 56/120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:07 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:07.889760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:07.890369 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:07.897246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.897692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:07.898501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:07.898928 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.050058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:08.059034 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:08.062342 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:08.067649 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fcfc0861-deb2-4ac6-8a6b-dd76aea3d866 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.177845 Jul 27 08:40:08.067649 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 65/121] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:07 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:08.072244 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-fad511ac-c96f-45e1-9f15-6c578111eede req-c00778e6-cd2d-499f-8801-0c4c9a0cea3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "name": "network-vif-plugged", "status": "completed", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:08.082071 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-fad511ac-c96f-45e1-9f15-6c578111eede req-c00778e6-cd2d-499f-8801-0c4c9a0cea3f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.082721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-fad511ac-c96f-45e1-9f15-6c578111eede req-c00778e6-cd2d-499f-8801-0c4c9a0cea3f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.094350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-fad511ac-c96f-45e1-9f15-6c578111eede req-c00778e6-cd2d-499f-8801-0c4c9a0cea3f service nova] Creating event network-vif-plugged:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:40:08.100736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-fad511ac-c96f-45e1-9f15-6c578111eede req-c00778e6-cd2d-499f-8801-0c4c9a0cea3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172400 Jul 27 08:40:08.101260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 57/122] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:08.310820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:08.311430 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:08.317345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.317790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.318580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.319017 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.451724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:08.460498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9c9b3156-1d72-47a1-984c-2ea588eccc3d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.153458 Jul 27 08:40:08.461284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 66/123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:08 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:08.581645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:08.582298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:08.588577 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.589121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.589889 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.590357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.743962 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:08.751471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e0da8538-95d3-4276-bdac-074166e8818e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.174364 Jul 27 08:40:08.752031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 58/124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:08 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:08.851126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:08.851601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:08.857944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.858373 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.859139 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:08.859575 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:08.999405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.001611 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e1a90163-bc2f-4e39-a671-e3cb49a0bb98 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.154787 Jul 27 08:40:09.002292 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 67/125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:08 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:09.089000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:09.089634 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:09.095673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.096112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.096875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.097906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.117755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:09.230822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.238736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.240250 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.241342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0b93facb-5c4f-45b7-8b2d-9b46e2175715 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.156350 Jul 27 08:40:09.241895 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 59/126] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:09 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:09.482520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:09.483058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:09.489006 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.489453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.490234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.490669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.622279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.630589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a766d487-28b0-418e-b066-364f108580ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.151970 Jul 27 08:40:09.631174 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 68/127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:09 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:09.773159 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:09.773816 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:09.780185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.780727 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.781560 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:09.781996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:09.921792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:09.930423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d74f1538-b61a-44a1-871d-91b881701d8b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.161855 Jul 27 08:40:09.930996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 60/128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:09 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:10.022376 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:10.022981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:10.028921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.033167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.033167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.033167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.175878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:10.183573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-adfcc43d-90c7-4659-b0a7-c2cceb4fa6c1 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.165184 Jul 27 08:40:10.184242 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 69/129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:10 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:10.264867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:10.265478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:10.272590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.273142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.274026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.275318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.407587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:10.415726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:10.420142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:10.420142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-eab43b7b-d1cc-49d1-a4f4-8b3b60dcb42b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.157415 Jul 27 08:40:10.420142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 61/130] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:10 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:10.651493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:10.652078 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:10.658016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.658487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.659298 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.659722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.798402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:10.800987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-149e9aae-b8ac-420e-ac2d-4f1b7cad8e7d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.153401 Jul 27 08:40:10.802352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 70/131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:10 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:10.954858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:10.955500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:10.962017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.962498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:10.963261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:10.963703 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.094123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.102015 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3ee30bee-d14f-4418-8ff0-7d755dc2c699 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.151140 Jul 27 08:40:11.102610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 62/132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:10 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:11.205608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:11.206483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:11.213404 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.213847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.214626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.215059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.345589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.353680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d166e12b-e0a3-44bd-bc1a-2de592a2475c tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.151943 Jul 27 08:40:11.354270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 71/133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:11 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:11.440781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:11.441367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:11.448026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.448467 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.449221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.449649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.577952 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.586460 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.588012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.589102 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-221f0ebd-fcf0-40b1-8abd-3e2a9403db1a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.152241 Jul 27 08:40:11.589651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 63/134] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:11 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:11.822517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:11.823188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:11.829409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.829857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.830646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:11.831087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:11.974164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:11.982586 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-acf9410b-b90b-4ac0-9b2e-1d1c37081542 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.164016 Jul 27 08:40:11.983148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 72/135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:11 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:12.123522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:12.124215 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:12.131006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.131610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.132361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.132790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.262834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:12.271015 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7e5c1020-b9b4-485c-9cc6-8dfb0bd6546c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.151226 Jul 27 08:40:12.271582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 64/136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:12 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:12.375204 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:12.375819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:12.382039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.382517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.383273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.383703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.531660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:12.542758 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6a0f6229-2bdc-4046-9ce4-0ed90d98d7bf tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.171432 Jul 27 08:40:12.543321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 73/137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:12 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:12.611810 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:12.612332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:12.618994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.619439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.620236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:12.620676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:12.803501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:12.813064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:12.813918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:12.815106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-990d89f0-ddc0-4361-8927-8a5046782fb9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.207280 Jul 27 08:40:12.816147 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 65/138] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:12 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:13.013160 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:13.013785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:13.021531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.021981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.022813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.023250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.040259 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-5e94623b-99e5-428d-b5d7-50961bddb292 req-4fa88618-9052-47dc-ae22-f03199801339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10fdcb61-b888-4d03-a3f2-e398132cfc27", "name": "network-vif-plugged", "status": "completed", "tag": "74a7aaef-2da9-4a35-9f8f-3a48630457ec"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:13.054383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5e94623b-99e5-428d-b5d7-50961bddb292 req-4fa88618-9052-47dc-ae22-f03199801339 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.056665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5e94623b-99e5-428d-b5d7-50961bddb292 req-4fa88618-9052-47dc-ae22-f03199801339 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.072428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-5e94623b-99e5-428d-b5d7-50961bddb292 req-4fa88618-9052-47dc-ae22-f03199801339 service nova] Creating event network-vif-plugged:74a7aaef-2da9-4a35-9f8f-3a48630457ec for instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 on hv-cinder-85117 Jul 27 08:40:13.079190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-5e94623b-99e5-428d-b5d7-50961bddb292 req-4fa88618-9052-47dc-ae22-f03199801339 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043988 Jul 27 08:40:13.080141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 66/139] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:40:13.181238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:13.189127 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0778f53f-edc1-42cc-b4fd-84b2abddb6f1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.181127 Jul 27 08:40:13.189685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 74/140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:13 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:13.292362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:13.293046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:13.300226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.300705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.301591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.302111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.437471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:13.445713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c91501f6-4f70-4b13-a0aa-5d4a9f5cc142 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.157551 Jul 27 08:40:13.446303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 67/141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:13 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:13.571064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:13.571820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:13.578419 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.578902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.579832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.580253 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.715217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:13.722604 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3d3cb503-6c1a-46ba-b6db-79886c40edb7 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.161756 Jul 27 08:40:13.723674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 75/142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:13 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:13.839900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:13.840892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:13.849046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.850480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.851496 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:13.852079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:13.995487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.003902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.006050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.007173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-26f2779b-ede1-4dae-a7e0-1972f489d398 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.172489 Jul 27 08:40:14.007726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 68/143] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:13 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:14.211087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:14.211812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:14.218447 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.218897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.219726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.220193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.351305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.358849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-dd82b29d-70f0-4eca-950b-c4f2698f66fb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.152779 Jul 27 08:40:14.368550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 76/144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:14 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:14.467073 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:14.467668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:14.474324 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.474814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.475579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.476007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.607918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.615819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-34aa2f37-9c23-4ee7-aad2-dc785081b3d6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.152686 Jul 27 08:40:14.616383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 69/145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:14 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:14.744241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:14.744843 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:14.750920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.751364 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.752110 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:14.752535 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:14.897138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:14.897911 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-036bd661-6b05-462c-8eae-77e78e985622 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.157387 Jul 27 08:40:14.898538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 77/146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:14 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:15.030027 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:15.030658 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:15.041217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.041860 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.046944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.046944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.380544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:15.384855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:15.389922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.390577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.392577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.393241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.554088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:15.576332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:15.579289 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:15.580763 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-79b47c58-8453-4169-b2e3-b80359e24e93 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.555090 Jul 27 08:40:15.582249 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 70/147] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:15 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:15.597671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:15.601878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:15.606725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e224df90-1400-4524-b1cc-3cf2df3eab58 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.231086 Jul 27 08:40:15.610232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 78/148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:15 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:15.636527 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:15.637129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:15.643156 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.647359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.647359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.647359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.774633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:15.782481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f33fbf5e-f53b-4e57-ad8a-bae949253507 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.149816 Jul 27 08:40:15.783042 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 71/149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:15 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:15.920368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:15.921032 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:15.927115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.927552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:15.928335 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:15.928781 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.063216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.071532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0638816f-9767-44b1-9c50-8cd7838c4bd5 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.156127 Jul 27 08:40:16.072101 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 79/150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:15 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:16.604078 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:16.604705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:16.610524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.611005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.611765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.612198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.627901 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:16.630921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:16.635715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.636252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.637139 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.637689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.765540 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.786628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.788246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.795030 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-86d3a974-51a8-4c90-a4e4-86bb838fa4f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.195723 Jul 27 08:40:16.795617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 72/151] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:16 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:16.806683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:16.807222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:16.828728 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.829176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.829946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:16.830436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:16.835551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.846831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-723ff8bf-642d-45c9-b91f-4ac1748ad40d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.222668 Jul 27 08:40:16.860349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 80/152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:16 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:16.991485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:16.999141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-063716b6-713a-4bf5-8741-6c2b566e7281 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.196269 Jul 27 08:40:16.999752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 73/153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:16 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:17.092849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:17.093459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:17.096381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:17.100525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.100972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.101736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.102184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.121478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-f2056748-69b0-4f5e-bc9a-05fe43dd0362 req-ec09ecf8-9ad6-4414-baf7-55163bcf3638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7739cba-0102-4d24-ac1e-904912fe2c65", "name": "network-vif-plugged", "status": "completed", "tag": "535f88dd-47a5-428c-ab18-ca28f688244a"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:17.131411 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-f2056748-69b0-4f5e-bc9a-05fe43dd0362 req-ec09ecf8-9ad6-4414-baf7-55163bcf3638 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.133122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-f2056748-69b0-4f5e-bc9a-05fe43dd0362 req-ec09ecf8-9ad6-4414-baf7-55163bcf3638 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.143403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-f2056748-69b0-4f5e-bc9a-05fe43dd0362 req-ec09ecf8-9ad6-4414-baf7-55163bcf3638 service nova] Creating event network-vif-plugged:535f88dd-47a5-428c-ab18-ca28f688244a for instance f7739cba-0102-4d24-ac1e-904912fe2c65 on hv-cinder-85117 Jul 27 08:40:17.149087 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-f2056748-69b0-4f5e-bc9a-05fe43dd0362 req-ec09ecf8-9ad6-4414-baf7-55163bcf3638 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Jul 27 08:40:17.149694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 74/154] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:40:17.241622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:17.249480 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f6fc07ca-6738-485c-9aa5-6d2a14d0dd61 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.160455 Jul 27 08:40:17.250060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 81/155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:17 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:17.820497 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:17.821201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:17.827815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.828261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.829232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.829676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.870798 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:17.871466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:17.881726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.882265 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.883240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:17.885515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:17.983063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:17.995897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:17.997414 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:17.998646 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e0f23d31-fe48-4747-9dac-9317cabebd13 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1408 microversion: 2.20 time: 0.182627 Jul 27 08:40:18.016317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 75/156] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:17 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:18.022633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:18.023553 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:18.029804 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:18.030369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:18.031293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:18.031898 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:18.038458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:18.052067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8514d741-6dcf-41ea-a00c-6834d294738b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.188301 Jul 27 08:40:18.065974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 82/157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:17 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:18.200281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:18.209268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b467c450-9c51-4580-a96c-c6c4bcf62b39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.191660 Jul 27 08:40:18.210163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 76/158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:18 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:18.272187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:18.273116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:18.292058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:18.302663 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:18.304166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:18.304676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:18.511932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:18.520226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f7c2ab25-c55e-4412-80b8-c6eb2a7154ca tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1315 microversion: 2.1 time: 0.253120 Jul 27 08:40:18.521259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 83/159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:18 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:19.029156 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:19.029765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:19.049200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.049704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.054685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.055750 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.074864 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:19.076125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:19.092213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.094170 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.096235 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.096946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.110992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:19.261899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.271623 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3c81ccad-e762-4ae6-a99f-2fce99477eaf tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.201437 Jul 27 08:40:19.272258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 84/160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:19 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:19.277019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-f93da362-baf0-4041-946a-9d22b9badb91 req-50955904-43d0-4283-ba36-1025c9ff5116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1df927-86a0-4ed5-aad6-b45dd817b46e", "name": "network-vif-plugged", "status": "completed", "tag": "55ebce99-8df7-4923-ac6f-3bba997bb3ff"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:19.288420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f93da362-baf0-4041-946a-9d22b9badb91 req-50955904-43d0-4283-ba36-1025c9ff5116 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.289117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f93da362-baf0-4041-946a-9d22b9badb91 req-50955904-43d0-4283-ba36-1025c9ff5116 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.294253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.304960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-f93da362-baf0-4041-946a-9d22b9badb91 req-50955904-43d0-4283-ba36-1025c9ff5116 service nova] Creating event network-vif-plugged:55ebce99-8df7-4923-ac6f-3bba997bb3ff for instance ba1df927-86a0-4ed5-aad6-b45dd817b46e on hv-cinder-85117 Jul 27 08:40:19.305266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.307026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.309076 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a92f46d9-c178-4b9f-8160-547501637986 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1601 microversion: 2.20 time: 0.283333 Jul 27 08:40:19.309649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 77/161] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:40:19 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1601 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:40:19.310751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-f93da362-baf0-4041-946a-9d22b9badb91 req-50955904-43d0-4283-ba36-1025c9ff5116 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Jul 27 08:40:19.311636 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 85/162] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:19.314273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:19.315022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:19.321516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.321957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.322874 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.323621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.339472 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:19.340837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:19.351924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.352571 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.353657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.354877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.491750 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.525851 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b75a6c0e-351e-46d4-8601-847f77f198c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.209042 Jul 27 08:40:19.527386 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 78/163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:19 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:19.533499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-507085ac-1031-455b-b433-1e7868266506 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.201187 Jul 27 08:40:19.534299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 86/164] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Jul 27 08:40:19 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:40:19.553135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:19.553922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:19.560875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.561742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.564400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:19.564400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:19.982393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:19.993868 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0df7b6b6-c93f-41ab-b7e3-a15b3566ba69 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1502 microversion: 2.1 time: 0.446385 Jul 27 08:40:19.994975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 79/165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:19 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:20.295070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:20.295751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:20.318195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:20.318710 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:20.319959 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:20.320831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:20.469416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:20.479908 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ce0a838b-ff3f-4d11-ac41-1fd3d15e3dcc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.190992 Jul 27 08:40:20.480476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 87/166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:20 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:20.550538 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:20.552081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:20.566228 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:20.574106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:20.583362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:20.584762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:20.947510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:20.957170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3b09d3d1-6824-4ca2-b935-61ab3855c823 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1362 microversion: 2.1 time: 0.411853 Jul 27 08:40:20.976517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 80/167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:20 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:21.500893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:21.501549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:21.507774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:21.508211 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:21.508981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:21.509393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:21.572320 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-02a3cfec-0bd8-4f9e-98f3-5dbecb0a9d23 req-d4da520f-c2c2-41da-9e22-402c11dadb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:21.588982 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-02a3cfec-0bd8-4f9e-98f3-5dbecb0a9d23 req-d4da520f-c2c2-41da-9e22-402c11dadb43 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:21.589423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-02a3cfec-0bd8-4f9e-98f3-5dbecb0a9d23 req-d4da520f-c2c2-41da-9e22-402c11dadb43 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:21.607313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-02a3cfec-0bd8-4f9e-98f3-5dbecb0a9d23 req-d4da520f-c2c2-41da-9e22-402c11dadb43 service nova] Creating event network-changed:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:40:21.620153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-02a3cfec-0bd8-4f9e-98f3-5dbecb0a9d23 req-d4da520f-c2c2-41da-9e22-402c11dadb43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051252 Jul 27 08:40:21.620770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 81/168] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:21.727135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:21.737640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7cd4bf20-a624-4d0b-949b-c616aadaae92 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.240122 Jul 27 08:40:21.739622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 88/169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:21 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:21.990341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:21.991025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:21.998951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:21.999775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:22.001746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:22.002642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:22.167182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:22.178006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-079024ba-9e0f-4c92-bc23-d51ff553e939 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1547 microversion: 2.1 time: 0.191648 Jul 27 08:40:22.185231 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 82/170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:21 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1547 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:22.211380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:22.212327 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:22.230108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:22.230583 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:22.236164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:22.236709 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:22.359592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e4c1fca7-afc5-40ed-9e98-ae1d6e607815 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153127 Jul 27 08:40:22.360574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 89/171] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:40:22 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:22.761171 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:22.762495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:22.795621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:22.796165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:22.800011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:22.800565 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:23.108331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:23.119129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-94b96e8f-93ce-426b-bd31-dd24796f5851 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1368 microversion: 2.1 time: 0.362042 Jul 27 08:40:23.124099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 83/172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:22 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:23.309495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcd793e1-e198-4267-bc81-a075c492fb73"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:23.315690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:23.346385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:23.346854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:23.351706 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:23.352088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.152669 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:24.154438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:24.161527 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:24.163024 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.164480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:24.165085 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.475208 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-226fe9cd-fa8c-4229-8dfd-90203d624f53 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "POST /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172446 Jul 27 08:40:24.484882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 90/173] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:40:23 2022] POST /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:24.503859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-840c16c3-7154-4e23-97b3-488e451f0b1f req-6751abb5-83b7-43e4-a3a7-ec9f0d9cecf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7739cba-0102-4d24-ac1e-904912fe2c65", "tag": "535f88dd-47a5-428c-ab18-ca28f688244a"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:24.522519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:24.539443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-18683d5e-c833-4a2a-b1f9-5fdf0f4dce4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1559 microversion: 2.1 time: 0.396675 Jul 27 08:40:24.539443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 84/174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:24 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1559 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:24.570223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-840c16c3-7154-4e23-97b3-488e451f0b1f req-6751abb5-83b7-43e4-a3a7-ec9f0d9cecf0 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:24.570949 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-840c16c3-7154-4e23-97b3-488e451f0b1f req-6751abb5-83b7-43e4-a3a7-ec9f0d9cecf0 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.572268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:24.574068 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:24.585389 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:24.586260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.587236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:24.588017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:24.596013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-840c16c3-7154-4e23-97b3-488e451f0b1f req-6751abb5-83b7-43e4-a3a7-ec9f0d9cecf0 service nova] Creating event network-changed:535f88dd-47a5-428c-ab18-ca28f688244a for instance f7739cba-0102-4d24-ac1e-904912fe2c65 on hv-cinder-85117 Jul 27 08:40:24.607551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-840c16c3-7154-4e23-97b3-488e451f0b1f req-6751abb5-83b7-43e4-a3a7-ec9f0d9cecf0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129204 Jul 27 08:40:24.608385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 91/175] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:24.749258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a4e93f20-f13c-4bcd-9b64-93787a866a8e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193092 Jul 27 08:40:24.750451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 85/176] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:40:24 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:40:26.407168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-a235f42a-3cb1-4bf7-9e23-eaba9afd7928 req-4ede462a-5096-457c-9ccb-e3641ca9ec58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1df927-86a0-4ed5-aad6-b45dd817b46e", "tag": "55ebce99-8df7-4923-ac6f-3bba997bb3ff"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:26.424753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a235f42a-3cb1-4bf7-9e23-eaba9afd7928 req-4ede462a-5096-457c-9ccb-e3641ca9ec58 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:26.425195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a235f42a-3cb1-4bf7-9e23-eaba9afd7928 req-4ede462a-5096-457c-9ccb-e3641ca9ec58 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:26.447781 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-a235f42a-3cb1-4bf7-9e23-eaba9afd7928 req-4ede462a-5096-457c-9ccb-e3641ca9ec58 service nova] Creating event network-changed:55ebce99-8df7-4923-ac6f-3bba997bb3ff for instance ba1df927-86a0-4ed5-aad6-b45dd817b46e on hv-cinder-85117 Jul 27 08:40:26.457232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-a235f42a-3cb1-4bf7-9e23-eaba9afd7928 req-4ede462a-5096-457c-9ccb-e3641ca9ec58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056572 Jul 27 08:40:26.461867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 92/177] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:35.340444 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=83 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:35.341191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=44 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:35.344930 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:35.345411 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:35.352321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:35.352769 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:35.353531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:35.353965 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:35.379679 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:40:35.725089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e1a6c5b6-9330-45d1-bc97-3929c9e68b85 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "DELETE /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 204 len: 0 microversion: 2.1 time: 0.385421 Jul 27 08:40:35.725702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 86/178] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:40:35 2022] DELETE /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:40:35.734761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:35.735557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:35.743275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:35.743779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:35.744545 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:35.744981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:35.876759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:35.884789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-11f0c333-982d-4568-a285-f8d054c2ad17 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.154617 Jul 27 08:40:35.885348 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 93/179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:35 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:36.906432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:36.907122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:36.913740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:36.914204 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:36.914987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:36.915415 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:37.041744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:37.049720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-da617e95-5d54-4444-a71b-4e2bbfd3ab64 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.147587 Jul 27 08:40:37.050316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 87/180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:36 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:38.071294 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:38.071902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:38.078504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:38.078999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:38.079815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:38.080252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:38.209036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:38.216920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2849dfa-227c-43e9-906e-ad86fc793cfe tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.150115 Jul 27 08:40:38.217482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 94/181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:38 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:39.239738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:39.245618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:39.246060 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:39.246845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:39.247272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:39.383435 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:39.392582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9eb81085-bdb8-44c1-9799-dc0f55360a96 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.158001 Jul 27 08:40:39.393152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 88/182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:39 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:40.413582 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:40.414205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:40.421969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:40.422457 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:40.423217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:40.423906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:40.567168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:40.575181 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ddcca856-24b5-4698-b63d-e6c3675f0b56 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.165772 Jul 27 08:40:40.575739 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 95/183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:40 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:41.596815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:41.597486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:41.603797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:41.604473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:41.605445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:41.605942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:41.739317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:41.747376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b735a994-3a50-428f-9c71-1c8fc820d2fc tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.154424 Jul 27 08:40:41.748038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 89/184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:41 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:40:42.769038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:42.769801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:42.776975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:42.777560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:42.778429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:42.778940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:42.923859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:42.928150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:40:42.933172 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4ba09097-9cf4-485b-af3c-92ba36ffb927 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1554 microversion: 2.1 time: 0.167948 Jul 27 08:40:42.943334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 96/185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:42 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:43.050953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-9e620145-daeb-49ed-b9cb-82a1f4cbc7af req-254d24a9-9c47-4f92-9e8d-6274e02f2826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10fdcb61-b888-4d03-a3f2-e398132cfc27", "name": "network-vif-deleted", "tag": "74a7aaef-2da9-4a35-9f8f-3a48630457ec"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:40:43.066196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-9e620145-daeb-49ed-b9cb-82a1f4cbc7af req-254d24a9-9c47-4f92-9e8d-6274e02f2826 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:43.066683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-9e620145-daeb-49ed-b9cb-82a1f4cbc7af req-254d24a9-9c47-4f92-9e8d-6274e02f2826 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:43.079459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-9e620145-daeb-49ed-b9cb-82a1f4cbc7af req-254d24a9-9c47-4f92-9e8d-6274e02f2826 service nova] Creating event network-vif-deleted:74a7aaef-2da9-4a35-9f8f-3a48630457ec for instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 on hv-cinder-85117 Jul 27 08:40:43.086008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-9e620145-daeb-49ed-b9cb-82a1f4cbc7af req-254d24a9-9c47-4f92-9e8d-6274e02f2826 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038490 Jul 27 08:40:43.086828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 90/186] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:40:43.954574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:43.955988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:43.971584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:43.972426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:43.973457 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:43.974254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:44.007815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:44.008666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:44.009132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lazy-loading 'fault' on Instance uuid 10fdcb61-b888-4d03-a3f2-e398132cfc27 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:40:44.072215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37554602ef6d461b97660ad6b337ed98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbedb0ad0538471e98b0641598f08c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:40:44.081445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-20650bae-f8d5-4366-ae9a-eefcf226d7f6 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 200 len: 1351 microversion: 2.1 time: 0.130587 Jul 27 08:40:44.082424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 97/187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:43 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:40:45.105587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:45.107143 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:45.113640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:45.114335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:45.116606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:45.116606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:45.135599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] HTTP exception thrown: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Request method failure captured: Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 HTTP/1.1 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnELfrcZjHJ5Hv-S5TTB-FE3eW8PsXQ70YXCD-Fb7w-ZYSZe1hOs9-vYcvd7aYNvg9kUfUz4ZdnA1uF3QR_mY9hGVQZsVmPXP-S4muOpm9pUkWNw4bmTU4s96aWAapwiCluTNB159CYPqfyE4ADmRXhUt8cp02nxyfssastMfzBkqk Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:40:45.140230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbedb0ad0538471e98b0641598f08c17", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 37554602ef6d461b97660ad6b337ed98 Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.147353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '10fdcb61-b888-4d03-a3f2-e398132cfc27'} Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:40:45.148165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.149649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.151017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Returning 404 to user: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:40:45.151017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4b137a8b-eef3-4bef-9243-f220f71c745f tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 404 len: 111 microversion: 2.1 time: 0.040852 Jul 27 08:40:45.151017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 91/188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:45 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:40:45.275743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:45.278671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:45.288844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:45.289286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:45.290306 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:45.290735 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:45.304264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] HTTP exception thrown: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Request method failure captured: Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27/os-volume_attachments HTTP/1.1 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnELfrcZjHJ5Hv-S5TTB-FE3eW8PsXQ70YXCD-Fb7w-ZYSZe1hOs9-vYcvd7aYNvg9kUfUz4ZdnA1uF3QR_mY9hGVQZsVmPXP-S4muOpm9pUkWNw4bmTU4s96aWAapwiCluTNB159CYPqfyE4ADmRXhUt8cp02nxyfssastMfzBkqk Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:40:45.308927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbedb0ad0538471e98b0641598f08c17", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 37554602ef6d461b97660ad6b337ed98 Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.314885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'server_id': '10fdcb61-b888-4d03-a3f2-e398132cfc27'} Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:40:45.315530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:45.316652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:45.318336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Returning 404 to user: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:40:45.318336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fd05afb7-abb7-468c-9876-8cd2d15aa2ce tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040063 Jul 27 08:40:45.318336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 98/189] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:40:45 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:40:46.828932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:46.829489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:46.840134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:46.840134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:46.840134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:46.840134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:46.856948 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] HTTP exception thrown: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Request method failure captured: Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 HTTP/1.1 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnELfrcZjHJ5Hv-S5TTB-FE3eW8PsXQ70YXCD-Fb7w-ZYSZe1hOs9-vYcvd7aYNvg9kUfUz4ZdnA1uF3QR_mY9hGVQZsVmPXP-S4muOpm9pUkWNw4bmTU4s96aWAapwiCluTNB159CYPqfyE4ADmRXhUt8cp02nxyfssastMfzBkqk Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:40:46.858495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbedb0ad0538471e98b0641598f08c17", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 37554602ef6d461b97660ad6b337ed98 Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.860093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '10fdcb61-b888-4d03-a3f2-e398132cfc27'} Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:40:46.862625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.865002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.866220 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Returning 404 to user: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:40:46.866220 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e7c7fe1a-1f78-42b5-b840-25d91cc1a1db tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "DELETE /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 404 len: 111 microversion: 2.1 time: 0.037709 Jul 27 08:40:46.866220 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 92/190] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:40:46 2022] DELETE /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:40:46.869203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:40:46.869826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] [instance: 10fdcb61-b888-4d03-a3f2-e398132cfc27] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:40:46.877286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:46.877742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:46.878530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:40:46.878986 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:40:46.898199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] HTTP exception thrown: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Request method failure captured: Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 HTTP/1.1 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnELfrcZjHJ5Hv-S5TTB-FE3eW8PsXQ70YXCD-Fb7w-ZYSZe1hOs9-vYcvd7aYNvg9kUfUz4ZdnA1uF3QR_mY9hGVQZsVmPXP-S4muOpm9pUkWNw4bmTU4s96aWAapwiCluTNB159CYPqfyE4ADmRXhUt8cp02nxyfssastMfzBkqk Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:40:46.899794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbedb0ad0538471e98b0641598f08c17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbedb0ad0538471e98b0641598f08c17", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: bbedb0ad0538471e98b0641598f08c17 Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-DeleteServersTestJSON-191602701 Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 37554602ef6d461b97660ad6b337ed98 Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-DeleteServersTestJSON-191602701-project Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.901091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '10fdcb61-b888-4d03-a3f2-e398132cfc27'} Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:40:46.901750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. Jul 27 08:40:46.902831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:40:46.904859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] Returning 404 to user: Instance 10fdcb61-b888-4d03-a3f2-e398132cfc27 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:40:46.905851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fa5e548a-d642-415f-87c9-73819f35e474 tempest-DeleteServersTestJSON-191602701 tempest-DeleteServersTestJSON-191602701-project] 10.222.0.40 "GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27" status: 404 len: 111 microversion: 2.1 time: 0.040753 Jul 27 08:40:46.906455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 99/191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:40:46 2022] GET /compute/v2.1/servers/10fdcb61-b888-4d03-a3f2-e398132cfc27 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:41:02.737001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:02.737001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:02.921685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-174515461", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:03.034343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] validate_networks() for [('d0a6cf88-547f-4cf8-ad21-f8b392f1c474', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:41:03.931366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:41:03.931954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:41:03.940786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:41:03.940786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:41:03.940786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:41:03.953109 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:03.958689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:03.958689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:03.958689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:03.981782 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:41:03.986513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for user 906ca078a25447b3b9c01f4fc76e7090 and project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:41:04.008930 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:41:04.013075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:41:04.207352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-bf8713c2-a382-4335-bb4b-4315af498be1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.484363 Jul 27 08:41:04.208448 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 93/192] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:41:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:41:04.221372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-537e434d-bcad-4c04-861e-e4610253704f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:04.224178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-537e434d-bcad-4c04-861e-e4610253704f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:04.246272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=38 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:04.252971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=12 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:04.324925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-537e434d-bcad-4c04-861e-e4610253704f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:04.333975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-537e434d-bcad-4c04-861e-e4610253704f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1221 microversion: 2.1 time: 0.117668 Jul 27 08:41:04.337578 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 100/193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:04 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:04.471493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1667876404", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:04.542976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] validate_networks() for [('d0a6cf88-547f-4cf8-ad21-f8b392f1c474', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:41:05.016999 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:41:05.018175 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:41:05.024004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:41:05.024004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:41:05.024004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:41:05.038490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:05.039086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:05.040146 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:05.040586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:05.060634 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:41:05.064783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for user 906ca078a25447b3b9c01f4fc76e7090 and project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:41:05.078246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:41:05.080864 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:41:05.310181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e2712830-d921-4e0d-ab48-0afb3e498cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.842660 Jul 27 08:41:05.319388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 94/194] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:41:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:41:05.324436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7b1d703f-7a9f-4800-a582-3ad7a94c40cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:05.325689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7b1d703f-7a9f-4800-a582-3ad7a94c40cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:05.407407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7b1d703f-7a9f-4800-a582-3ad7a94c40cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:05.423204 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7b1d703f-7a9f-4800-a582-3ad7a94c40cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1222 microversion: 2.1 time: 0.103440 Jul 27 08:41:05.435448 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 101/195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:05 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:06.449482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7c108e38-6896-4e35-abae-e8ccfb004aa6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:06.449482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7c108e38-6896-4e35-abae-e8ccfb004aa6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:06.547474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7c108e38-6896-4e35-abae-e8ccfb004aa6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:06.555237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7c108e38-6896-4e35-abae-e8ccfb004aa6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1222 microversion: 2.1 time: 0.112425 Jul 27 08:41:06.573401 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 95/196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:06 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:07.577398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:07.578014 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:07.593203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:07.593661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:07.598860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:07.601009 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:07.787740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:07.800152 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f970b338-9799-40f3-89f6-b43c8b6e89fe tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1218 microversion: 2.1 time: 0.226563 Jul 27 08:41:07.818343 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 102/197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:07 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:08.831993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:08.836179 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:08.845621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:08.846065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:08.847159 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:08.847760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:08.985548 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:08.993699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7bad6780-4302-48ad-8867-890ce322c6f7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1282 microversion: 2.1 time: 0.166677 Jul 27 08:41:09.006830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 96/198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:08 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:10.017406 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:10.018811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:10.026707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:10.031396 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:10.032466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:10.033118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:10.200722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:10.226374 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-63130eeb-ce2e-4bca-87ca-eda83c103049 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1280 microversion: 2.1 time: 0.213850 Jul 27 08:41:10.230114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 103/199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:10 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:11.251787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:11.252429 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:11.259105 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:11.259558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:11.261364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:11.261808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:11.284573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-63d311f8-50fa-4090-848f-2ccf1c963f58 req-33dd0d92-01f4-4535-8c90-cc15e5b40559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac824ac8-4d92-4c41-8a17-c96d40d2ce05", "tag": "75614ea5-42c0-4439-8250-f07133e78608"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:11.307717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-63d311f8-50fa-4090-848f-2ccf1c963f58 req-33dd0d92-01f4-4535-8c90-cc15e5b40559 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:11.308650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-63d311f8-50fa-4090-848f-2ccf1c963f58 req-33dd0d92-01f4-4535-8c90-cc15e5b40559 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:11.321734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-63d311f8-50fa-4090-848f-2ccf1c963f58 req-33dd0d92-01f4-4535-8c90-cc15e5b40559 service nova] Creating event network-changed:75614ea5-42c0-4439-8250-f07133e78608 for instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 on hv-cinder-85117 Jul 27 08:41:11.334780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-63d311f8-50fa-4090-848f-2ccf1c963f58 req-33dd0d92-01f4-4535-8c90-cc15e5b40559 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053855 Jul 27 08:41:11.337283 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 104/200] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:11.462619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:11.474011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-de4e46b0-937f-4901-b46b-ca4303d5238f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.222530 Jul 27 08:41:11.474011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 97/201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:11 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:12.496567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:12.497262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:12.508630 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:12.509803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:12.511459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:12.511918 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:12.701712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:12.711407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-86327837-3ace-40bc-914c-05a6ac52776c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.219543 Jul 27 08:41:12.712305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 105/202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:12 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:13.723085 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-a5906c21-c5e3-4ac9-88ea-a2c75b2e8cfd req-71336d24-8e1c-467d-ae98-dc6b5474e717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcaa9a44-f92c-4932-bcfc-6f5195df3936", "tag": "7704beb8-3578-4840-ad3c-229cb797c582"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:13.735114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:13.736437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:13.753833 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:13.757249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:13.758637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:13.761179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:13.764575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-a5906c21-c5e3-4ac9-88ea-a2c75b2e8cfd req-71336d24-8e1c-467d-ae98-dc6b5474e717 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:13.765227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-a5906c21-c5e3-4ac9-88ea-a2c75b2e8cfd req-71336d24-8e1c-467d-ae98-dc6b5474e717 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:13.794917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-a5906c21-c5e3-4ac9-88ea-a2c75b2e8cfd req-71336d24-8e1c-467d-ae98-dc6b5474e717 service nova] Creating event network-changed:7704beb8-3578-4840-ad3c-229cb797c582 for instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 on hv-cinder-85117 Jul 27 08:41:13.807136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-a5906c21-c5e3-4ac9-88ea-a2c75b2e8cfd req-71336d24-8e1c-467d-ae98-dc6b5474e717 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089539 Jul 27 08:41:13.814104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 98/203] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:13.967731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:13.975889 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-65eac7db-8d45-4201-a40a-5336f94a63d5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.246691 Jul 27 08:41:13.976439 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 106/204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:13 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:41:14.998261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:14.999030 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:15.028167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:15.031365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:15.036841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:15.037470 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:15.059471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=4 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:15.508168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:15.518927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b564e392-7a71-498d-84ad-474d7af23f7e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.525065 Jul 27 08:41:15.520137 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 99/205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:14 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:16.541111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:16.542377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:16.554551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=4 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:16.556570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:16.557212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:16.558183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:16.558773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:16.727557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:16.736156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0b224cf7-33a2-46ed-9c86-e29fac38880a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.199048 Jul 27 08:41:16.746903 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 107/206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:16 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:17.766167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:17.766991 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:17.778838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=14 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:17.791405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:17.793525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:17.793525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:17.793525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:18.045232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:18.055303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7047527c-b56f-410a-a19a-874aead3bed1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.296080 Jul 27 08:41:18.056224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 100/207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:17 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:19.075853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:19.076460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:19.084310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:19.084773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:19.089495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:19.089495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:19.510367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:19.517731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ed0ee383-cc87-45de-9992-a21e77aab7ea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.445703 Jul 27 08:41:19.518346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 108/208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:19 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:20.542990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:20.543603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:20.554963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:20.555683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:20.556802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:20.557392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:20.724506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:20.737254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-64af2057-12fc-4426-8329-e2375b8cac3b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.200424 Jul 27 08:41:20.738249 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 101/209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:20 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:21.760200 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:21.760831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:21.767887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:21.770635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:21.770635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:21.770635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:21.930190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:21.939443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1bf32c0e-9fe1-4932-868b-3c7392fe474c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.182759 Jul 27 08:41:21.940662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 109/210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:21 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:22.961549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:22.962858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:22.971037 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:22.971968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:22.973617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:22.974469 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:23.106627 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:23.114287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f421c999-3e71-4a8d-bcb9-e82a903130fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.156916 Jul 27 08:41:23.126305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 102/211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:22 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:23.635692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-f074061c-21cd-4dc3-8cb5-b0e820ac4108 req-6a6dc6e5-50fb-4983-a551-38332d4ef7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac824ac8-4d92-4c41-8a17-c96d40d2ce05", "name": "network-vif-plugged", "status": "completed", "tag": "75614ea5-42c0-4439-8250-f07133e78608"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:23.647517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f074061c-21cd-4dc3-8cb5-b0e820ac4108 req-6a6dc6e5-50fb-4983-a551-38332d4ef7d5 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:23.648210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f074061c-21cd-4dc3-8cb5-b0e820ac4108 req-6a6dc6e5-50fb-4983-a551-38332d4ef7d5 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:23.661925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-f074061c-21cd-4dc3-8cb5-b0e820ac4108 req-6a6dc6e5-50fb-4983-a551-38332d4ef7d5 service nova] Creating event network-vif-plugged:75614ea5-42c0-4439-8250-f07133e78608 for instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 on hv-cinder-85117 Jul 27 08:41:23.667444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-f074061c-21cd-4dc3-8cb5-b0e820ac4108 req-6a6dc6e5-50fb-4983-a551-38332d4ef7d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Jul 27 08:41:23.671430 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 110/212] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:24.139117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:24.139846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:24.151789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:24.152291 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:24.153299 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:24.153812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:24.427821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:24.435438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-29a08333-0467-4397-bddf-3b9125e737bd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.300676 Jul 27 08:41:24.436004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 103/213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:24 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:24.791828 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-884da75f-2fcf-424d-9031-24b3755394a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'create', calling method: .version_select at 0x7f78f0f6f790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1237448761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEOKKduAHJS2lwLi+w+4L1/1Ll4a0AYqXF67/nc/Vhn2bv9o/KL6cpTTpWePwDM8pSd9+jc5MEaMQeG8LXkReBM0a1+S0KfgrZinx05PRx/d81zkaoPYnfQzLnANNs+aw=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:24.807193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-884da75f-2fcf-424d-9031-24b3755394a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Getting quotas for project 52bd08da2d1746c6a84cf75143ae6bf6. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:41:24.810893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-884da75f-2fcf-424d-9031-24b3755394a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Getting quotas for user 789e8d5e223a42379153011a7b986d50 and project 52bd08da2d1746c6a84cf75143ae6bf6. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:41:24.913604 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-884da75f-2fcf-424d-9031-24b3755394a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.126464 Jul 27 08:41:24.914296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 111/214] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:41:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:25.078334 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-913630999", "imageRef": "2fb6cab0-ae07-4c46-9060-1b8b00a83d58", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1237448761", "networks": [{"uuid": "19667394-873e-4fb0-a227-f5cd6f6c3a28"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:25.131606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] validate_networks() for [('19667394-873e-4fb0-a227-f5cd6f6c3a28', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:41:25.457598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:25.458347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:25.465019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:25.465808 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:25.466977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:25.467566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:25.526391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:41:25.526391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:41:25.526391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:41:25.526391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:41:25.527121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:41:25.535809 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:25.536257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:25.537295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:25.537726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:25.573805 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Getting quotas for project 52bd08da2d1746c6a84cf75143ae6bf6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:41:25.580887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Getting quotas for user 789e8d5e223a42379153011a7b986d50 and project 52bd08da2d1746c6a84cf75143ae6bf6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:41:25.594227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:41:25.597112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fb6cab0-ae07-4c46-9060-1b8b00a83d58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:41:25.619371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:25.634763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4e606042-dfda-4abd-8aac-d95dc2c627cd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.181633 Jul 27 08:41:25.640663 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 112/215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:25 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:25.682544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-ceefc2e1-7d14-470b-be09-d38cc8327849 req-e219f213-c6d1-4837-83ea-d58345a7db74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaa9a44-f92c-4932-bcfc-6f5195df3936", "name": "network-vif-plugged", "status": "completed", "tag": "7704beb8-3578-4840-ad3c-229cb797c582"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:25.692135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ceefc2e1-7d14-470b-be09-d38cc8327849 req-e219f213-c6d1-4837-83ea-d58345a7db74 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:25.692560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ceefc2e1-7d14-470b-be09-d38cc8327849 req-e219f213-c6d1-4837-83ea-d58345a7db74 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:25.703743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-ceefc2e1-7d14-470b-be09-d38cc8327849 req-e219f213-c6d1-4837-83ea-d58345a7db74 service nova] Creating event network-vif-plugged:7704beb8-3578-4840-ad3c-229cb797c582 for instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 on hv-cinder-85117 Jul 27 08:41:25.709052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-ceefc2e1-7d14-470b-be09-d38cc8327849 req-e219f213-c6d1-4837-83ea-d58345a7db74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Jul 27 08:41:25.709757 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 113/216] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:25.730512 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b4acd677-0861-4824-87b3-8ac04d52bbc5 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655922 Jul 27 08:41:25.731092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 104/217] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:41:25.742898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-13be85d9-db40-40eb-96d9-53b379c816f9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:25.743589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-13be85d9-db40-40eb-96d9-53b379c816f9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:25.799781 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-13be85d9-db40-40eb-96d9-53b379c816f9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:25.812121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-13be85d9-db40-40eb-96d9-53b379c816f9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1258 microversion: 2.1 time: 0.069715 Jul 27 08:41:25.812121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 114/218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:25 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:26.655280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:26.655879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:26.662709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:26.663149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:26.663902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:26.664333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:26.828056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-29e49b8e-9e25-40ff-b1ce-39448f5ff70e tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:26.832368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-29e49b8e-9e25-40ff-b1ce-39448f5ff70e tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:26.854262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:26.865588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5413bd18-2c65-4b01-9b6e-ce03d28adc31 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.212796 Jul 27 08:41:26.866713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 105/219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:26 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:26.888753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-29e49b8e-9e25-40ff-b1ce-39448f5ff70e tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:26.897569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-29e49b8e-9e25-40ff-b1ce-39448f5ff70e tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1258 microversion: 2.1 time: 0.073199 Jul 27 08:41:26.898182 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 115/220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:26 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:27.887396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:27.887995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:27.894250 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:27.894705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:27.895510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:27.895941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:27.920114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:27.921670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:27.928994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:27.934161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:27.934161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:27.934161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:27.996629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:28.004021 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c640bb89-9de1-40b8-9dc7-839e0a8161a0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1262 microversion: 2.1 time: 0.087962 Jul 27 08:41:28.004835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 116/221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:27 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:41:28.027901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:28.036695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d45e93f2-cc4c-45ea-b9e0-50b739b38d8c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1322 microversion: 2.1 time: 0.153096 Jul 27 08:41:28.037588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 106/222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:27 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:29.025249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:29.025860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:29.032462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.032926 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.033671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.034105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.057079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:29.062904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:29.063780 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.064236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.065011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.065452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.095367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:29.103251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3da0e4d8-ddb7-41a3-8760-23a6fafc6a53 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1310 microversion: 2.1 time: 0.081927 Jul 27 08:41:29.103820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 117/223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:29 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:29.201000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:29.208840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1b0fab6d-c4a9-47cc-a4ca-26f53554b99e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1516 microversion: 2.1 time: 0.155590 Jul 27 08:41:29.209399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 107/224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:29 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:41:29.229887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:29.232061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:29.238848 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.242806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.242806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.242806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.263563 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lazy-loading 'flavor' on Instance uuid dcaa9a44-f92c-4932-bcfc-6f5195df3936 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:41:29.526832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1ec38096-c3b0-4a4b-affa-6d7f375708d4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936/action" status: 200 len: 32 microversion: 2.1 time: 0.300826 Jul 27 08:41:29.527631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 118/225] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:41:29 2022] POST /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:41:29.538017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:29.538690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:29.546706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.547153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.547925 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:29.548798 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:29.940305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:29.949445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-474a5a80-5a49-43a2-9875-8e565dd00ff7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.415972 Jul 27 08:41:29.950034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 108/226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:29 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:30.125527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:30.126259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:30.133905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:30.134383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:30.135163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:30.135600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:30.200930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:30.209039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9b5c8fe9-48eb-4cf7-8bc7-bfb1e4570c83 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1316 microversion: 2.1 time: 0.087881 Jul 27 08:41:30.209768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 119/227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:30 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:30.981897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:30.983550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:30.991421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:30.992194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:30.993202 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:30.993838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:31.142766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:31.158510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7e3f3026-7b6c-42bf-becf-1954cc8fcfb2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.180871 Jul 27 08:41:31.160419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 109/228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:30 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:31.231232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:31.231748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:31.239506 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:31.239961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:31.240734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:31.241172 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:31.378878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:31.386544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ed1f6877-8bad-47a0-85b9-ce311be45683 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.159201 Jul 27 08:41:31.387111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 120/229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:31 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:32.180635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:32.181168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:32.187196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:32.187648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:32.188419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:32.188854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:32.316622 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:32.324475 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-24aeb96f-a625-427a-a0c8-fb3f3556b83b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.147732 Jul 27 08:41:32.325042 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 110/230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:32 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:32.407280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:32.407993 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:32.416849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:32.417543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:32.418492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:32.419068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:32.443145 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:32.564724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:32.573858 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2b45ad24-817f-4ef6-a003-f5c3ebdacda4 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.170451 Jul 27 08:41:32.574477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 121/231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:32 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:41:33.346618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:33.347218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:33.349056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:33.353880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:33.354384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:33.355235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:33.355680 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:33.504035 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:33.511822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d473b32d-4239-4836-aa54-8f8b09de830c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.169033 Jul 27 08:41:33.512392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 111/232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:33 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:33.596270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:33.597017 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:33.604012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:33.604495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:33.605271 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:33.605708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:33.745168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:33.755106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-15e86bcc-9856-4de4-ac04-fc5e94a9b511 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.162570 Jul 27 08:41:33.756112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 122/233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:33 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:34.533083 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:34.533686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:34.540376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:34.540820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:34.541577 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:34.542673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:34.545270 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=93 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:34.685808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:34.694906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1f434639-ef87-430f-a185-7284fe71c225 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.165674 Jul 27 08:41:34.706865 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 112/234] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:34 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:34.776897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:34.778288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:34.785258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:34.786044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:34.787055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:34.787727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:34.932311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:34.940805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d21185d0-9ead-4962-9adc-ce21affc4fe9 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.167188 Jul 27 08:41:34.941227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 123/235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:34 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:35.715925 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:35.716499 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:35.718544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:35.719206 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:35.725055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:35.725504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:35.726295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:35.726738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:35.879440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:35.887109 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-be497052-66c3-40eb-bbae-135afa07f0a6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.175132 Jul 27 08:41:35.887674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 113/236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:35 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:35.964722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:35.965463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:35.967804 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:35.972662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:35.973108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:35.973929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:35.974633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:36.118188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:36.126063 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-63e4c6c7-1007-4c97-a0f6-740c55a2e16d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.165151 Jul 27 08:41:36.126750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 124/237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:35 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:36.914091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:36.915066 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:36.923713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:36.944412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:36.944412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:36.944412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:37.144869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:37.144869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d79a9763-e3e5-427e-b5b9-ad9ef2360678 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.180339 Jul 27 08:41:37.144869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 114/238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:36 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:37.150429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:37.151263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:37.157415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=8 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:37.160397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:37.160857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:37.161708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:37.162075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:37.311402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:37.326453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-85c7d58a-bf93-405f-a503-d09ffaebe825 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.180343 Jul 27 08:41:37.327368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 125/239] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:37 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:38.165315 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:38.166471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:38.175993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:38.176722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:38.177717 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:38.178522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:38.313038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:38.323310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f4b7549e-3ae0-44ba-96da-a39dd798b393 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.162293 Jul 27 08:41:38.323887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 115/240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:38 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:38.348884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:38.349550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:38.356364 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:38.356836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:38.357584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:38.358163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:38.494802 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:38.503500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-af7116a1-f408-42e9-b438-de6320faa33a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.159566 Jul 27 08:41:38.504307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 126/241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:38 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:39.344459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:39.345064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:39.351713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:39.352155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:39.352907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:39.353339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:39.482212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:39.490281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-96b75a56-9adf-48f3-bed6-b3e5c65929aa tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.149660 Jul 27 08:41:39.490851 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 116/242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:39 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:39.524283 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:39.524912 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:39.531367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:39.531811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:39.532566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:39.532999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:39.658507 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:39.666459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-877f2e91-a06a-403d-8211-7e594c7e9dc3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.145918 Jul 27 08:41:39.667024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 127/243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:39 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:40.510935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:40.511535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:40.517503 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:40.518623 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:40.519600 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:40.520031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:40.645450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:40.652807 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e106d75a-9a05-43b7-b457-c3a4f1fa6cbb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.145776 Jul 27 08:41:40.653364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 117/244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:40 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:40.687188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:40.687794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:40.694841 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:40.695287 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:40.696050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:40.696480 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:40.822982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:40.831256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2f95f8cc-cb39-416f-aa3c-545045cb88f8 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.147158 Jul 27 08:41:40.831818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 128/245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:40 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:41.673974 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:41.675513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:41.681484 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:41.681930 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:41.682733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:41.683172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:41.812125 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:41.819882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-57d7dba4-325d-4c62-9074-250ef5811b38 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.149828 Jul 27 08:41:41.820445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 118/246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:41 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:41.852263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:41.852877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:41.859436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:41.863362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:41.863362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:41.863362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:41.991196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:41.996492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9cb9e608-73cd-481e-a636-cf1b162df582 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.148134 Jul 27 08:41:41.997057 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 129/247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:41 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:41:42.841557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:42.842217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:42.848209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:42.848645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:42.849391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:42.849819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:42.977317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:42.984694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ee10efe6-f759-4551-91a4-1a28e0fabecf tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.146971 Jul 27 08:41:42.985255 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 119/248] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:42 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:43.016810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:43.017414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:43.024004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:43.024452 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:43.025210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:43.025643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:43.153827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:43.161817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0d7134cb-275b-4683-bf60-16a50eba632a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.148770 Jul 27 08:41:43.162423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 130/249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:43 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:44.005537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:44.006089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:44.012195 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:44.012648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:44.013410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:44.013850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:44.118963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-396ccece-4d86-42c9-a094-ec5e37aff62b req-a2cf3dbb-d560-4e27-a4c0-baa27bbd41fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:44.129528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-396ccece-4d86-42c9-a094-ec5e37aff62b req-a2cf3dbb-d560-4e27-a4c0-baa27bbd41fb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:44.134337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-396ccece-4d86-42c9-a094-ec5e37aff62b req-a2cf3dbb-d560-4e27-a4c0-baa27bbd41fb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:44.143789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-396ccece-4d86-42c9-a094-ec5e37aff62b req-a2cf3dbb-d560-4e27-a4c0-baa27bbd41fb service nova] Creating event network-changed:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:41:44.149754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-396ccece-4d86-42c9-a094-ec5e37aff62b req-a2cf3dbb-d560-4e27-a4c0-baa27bbd41fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Jul 27 08:41:44.150719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 131/250] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:44.188597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:44.189292 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:44.196566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:44.197015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:44.197919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:44.198392 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:44.212933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:44.222919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0a81b8e8-a41c-4344-9830-0fa8f67a7658 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.221402 Jul 27 08:41:44.224387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 120/251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:44 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:44.468741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:44.476982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c3668e90-011f-4ee1-a03c-e77c48ab31de tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.293457 Jul 27 08:41:44.477562 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 132/252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:44 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:45.244243 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:45.244786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:45.250838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:45.251304 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:45.252098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:45.252562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:45.381881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:45.389307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4299e820-3cce-4f18-ab9f-a6be41da4aea tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.148968 Jul 27 08:41:45.389875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 121/253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:45 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:45.498569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:45.499097 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:45.505524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:45.506020 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:45.506815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:45.507251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:45.632795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:45.640143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d1b18ef6-3f32-464a-b5a9-e572b46af681 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.145603 Jul 27 08:41:45.640700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 133/254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:45 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:46.409943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:46.410584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:46.416562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:46.417007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:46.417760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:46.418215 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:46.544648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:46.553513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9cacd9cd-bfc5-4029-aa74-0c1fea595d13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.147376 Jul 27 08:41:46.554094 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 122/255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:46 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:46.661569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:46.662102 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:46.668583 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:46.669028 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:46.669779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:46.670230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:46.800363 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:46.807715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fd2c134f-8cae-45af-b5e2-0d0c8f2e6885 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.150666 Jul 27 08:41:46.808274 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 134/256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:46 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:47.575209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:47.575818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:47.582743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:47.583195 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:47.583950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:47.584384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:47.714402 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:47.721872 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7b7dd294-1bd6-4a63-8619-b82cb0c8e1b5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.150605 Jul 27 08:41:47.722463 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 123/257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:47 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:47.828122 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:47.828722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:47.835543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:47.835984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:47.836734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:47.837164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:47.965386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:47.973385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8cb8f930-f088-425a-b5b2-26b7b53b5f39 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.148980 Jul 27 08:41:47.973969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 135/258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:47 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:48.742878 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:48.743480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:48.749430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:48.749879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:48.750666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:48.751120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:48.877210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:48.884691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-add56ab5-e87d-479a-8e1c-70d3f28932b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.145641 Jul 27 08:41:48.885254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 124/259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:48 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:48.994478 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:48.995082 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:49.001479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:49.002448 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:49.003367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:49.003806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:49.134188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:49.141493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4db14ece-a04f-4668-b55c-dcd31096863c tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.150848 Jul 27 08:41:49.142064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 136/260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:48 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:49.905833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:49.906461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:49.912775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:49.913221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:49.914089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:49.914545 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:50.039733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:50.047194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-968c6c75-ea85-458f-9e3c-e959f99dda47 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.145176 Jul 27 08:41:50.047752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 125/261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:49 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:50.162675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:50.163221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:50.169686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:50.170135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:50.170932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:50.171367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:50.297507 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:50.305652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ebc63c62-660c-45f5-b3b4-e45fc44d9a1f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.146932 Jul 27 08:41:50.306239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 137/262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:50 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:51.068548 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:51.069142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:51.075173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:51.075621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:51.076374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:51.076808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:51.208099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:51.215629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d33fb72b-7594-42bd-af0d-4b4f6a7506ff tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.151137 Jul 27 08:41:51.216197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 126/263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:51 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:51.327556 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:51.328162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:51.335494 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:51.335936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:51.336712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:51.337144 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:51.470558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:51.474030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:51.478405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3a46f299-caeb-4fe5-8bf0-48ed15a53edc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.154763 Jul 27 08:41:51.478974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 138/264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:51 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:51.538091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-bf603792-b0b1-478f-9725-ea4eb3079ed3 req-45d1d706-4ea8-445a-806a-c8b1e2338ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "name": "network-vif-plugged", "status": "completed", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:51.551557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-bf603792-b0b1-478f-9725-ea4eb3079ed3 req-45d1d706-4ea8-445a-806a-c8b1e2338ae4 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:51.552003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-bf603792-b0b1-478f-9725-ea4eb3079ed3 req-45d1d706-4ea8-445a-806a-c8b1e2338ae4 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:51.563317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-bf603792-b0b1-478f-9725-ea4eb3079ed3 req-45d1d706-4ea8-445a-806a-c8b1e2338ae4 service nova] Creating event network-vif-plugged:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:41:51.569221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-bf603792-b0b1-478f-9725-ea4eb3079ed3 req-45d1d706-4ea8-445a-806a-c8b1e2338ae4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Jul 27 08:41:51.571635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 127/265] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:41:52.237478 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:52.238035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:52.244436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:52.244881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:52.245632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:52.246068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:52.371622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:52.379054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2bbd6629-06d6-48ed-abdd-2cac17d66026 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.146128 Jul 27 08:41:52.379643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 139/266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:52 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:52.498891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:52.499510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:52.505796 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:52.506265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:52.507015 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:52.507443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:52.637836 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:52.645744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4c833f83-5201-4264-894b-b984fc46bfbe tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.151064 Jul 27 08:41:52.646328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 128/267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:52 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:53.400880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:53.401526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:53.408730 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:53.409189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:53.409937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:53.410400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:53.536474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:53.543861 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-38cd64a6-1e65-4c9b-a7e1-dee5b50a4dba tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.146960 Jul 27 08:41:53.544413 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 140/268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:53 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:53.666412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:53.666929 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:53.673066 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:53.678677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:53.678677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:53.678677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:53.691310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:41:53.805079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:53.812612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-afbfd5bb-f9ed-47a5-9e26-68778074993b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1358 microversion: 2.1 time: 0.150138 Jul 27 08:41:53.813179 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 129/269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:53 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:54.565101 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:54.565617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:54.571800 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:54.572240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:54.573005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:54.573436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:54.703845 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:54.712079 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-48842ac3-c161-4bc6-9932-06439eb5cb23 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.151111 Jul 27 08:41:54.712638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 141/270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:54 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:54.834406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:54.835011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:54.840977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:54.841422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:54.842200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:54.842636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:54.967597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:54.975019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e7a69f62-703c-4f2d-8ed7-af52ea5bb626 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1546 microversion: 2.1 time: 0.144447 Jul 27 08:41:54.975585 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 130/271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:54 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:54.996010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:54.996615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:55.003385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.003833 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.004591 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.005024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.129622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:55.137137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2cebcd9c-e8b7-4eb3-9edf-abff496a8b60 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1546 microversion: 2.1 time: 0.145035 Jul 27 08:41:55.137692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 142/272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:54 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1546 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:55.156905 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:55.161678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:55.162456 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Searching by: {'deleted': False, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6'} {{(pid=129924) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 27 08:41:55.168981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.169418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.170218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.170649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.263611 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.multi_cell_list [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129924) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 08:41:55.355516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c3ed7a64-43b8-455c-a9e7-8f6b77912218 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202272 Jul 27 08:41:55.356092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 131/273] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Jul 27 08:41:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:55.367776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:55.368373 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:55.374315 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.374756 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.375499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.375925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.505007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:55.512492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6ee3e564-5298-4249-8974-7a5a4c55efe7 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1546 microversion: 2.1 time: 0.148515 Jul 27 08:41:55.513052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 143/274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:55 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:55.732567 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:55.733191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:55.739521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.739964 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.740717 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:55.741148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:55.871760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:55.880223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a5695ecf-1872-41a3-99b7-1868e431d916 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.151650 Jul 27 08:41:55.880792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 132/275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:55 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:56.901832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:56.902524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:56.908992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:56.910026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:56.910815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:56.911249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:57.038508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:57.045888 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f97be936-300a-44dd-a0be-59953301b21f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.147925 Jul 27 08:41:57.046473 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 144/276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:56 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:58.065817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:58.066936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:58.073069 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:58.073517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:58.074290 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:58.074716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:58.205097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:58.213675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a3201804-971b-4e79-91ea-230f634572d1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.151721 Jul 27 08:41:58.214280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 133/277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:58 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:41:58.399340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eb6ccb9-40c0-4036-aac2-797101494d81"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:41:58.401743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:58.408255 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:58.408697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:58.409450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:58.409878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:59.125297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-129ad612-12cb-49e7-ac1d-0d6e08afb594 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730299 Jul 27 08:41:59.126108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 145/278] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:41:58 2022] POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:41:59.233460 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:41:59.234112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:41:59.240535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:59.240980 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:59.241726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:41:59.242170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:41:59.380631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:41:59.388487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7a6d48d6-269f-42b5-9ae3-449bae419df3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.158712 Jul 27 08:41:59.389082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 134/279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:41:59 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:00.410619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:00.411243 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:00.417863 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:00.418347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:00.419099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:00.419528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:00.546049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:00.554003 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6e727a35-6de9-4fa3-98d7-c159f595a5d3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.147762 Jul 27 08:42:00.554590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 146/280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:00 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:01.575543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:01.576224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:01.583299 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:01.583745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:01.584517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:01.584939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:01.883666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:01.891184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-93cc1bda-a519-4b31-9e2d-4ab8ef32bdc2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.319447 Jul 27 08:42:01.891754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 135/281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:01 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:02.912969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:02.913594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:02.920027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:02.920468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:02.921216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:02.921644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:03.061238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:03.069432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-58d4a438-ec55-4e91-a28a-776593df0970 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1522 microversion: 2.1 time: 0.160408 Jul 27 08:42:03.070001 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 147/282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:02 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:04.090676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:04.091274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:04.093122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=50 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:04.097790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:04.098254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:04.105515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:04.105515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:04.226091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:04.233390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d72310ce-c720-4d27-8941-c78e9c8a0248 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1502 microversion: 2.1 time: 0.146550 Jul 27 08:42:04.233945 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 136/283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:04 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:04.254478 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:04.255086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:04.261528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:04.261999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:04.262790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:04.263227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:04.387943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:04.395437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-178b0aaf-6f58-429b-911e-2210856969fc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1515 microversion: 2.1 time: 0.144921 Jul 27 08:42:04.396000 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 148/284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:04 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:07.150009 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:07.152290 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:07.154138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:07.158957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:07.159407 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:07.160167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:07.160600 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:07.183306 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lazy-loading 'flavor' on Instance uuid ac824ac8-4d92-4c41-8a17-c96d40d2ce05 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:42:07.475103 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-551bc17b-f583-49c0-9f64-9433543a19ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/action" status: 200 len: 32 microversion: 2.1 time: 0.329435 Jul 27 08:42:07.476258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 137/285] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:42:07 2022] POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:42:07.485614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:07.486249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:07.488727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=50 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:07.493601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:07.494043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:07.494892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:07.495319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:07.629156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:07.637642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-637172ad-c72b-445a-ac43-ce2511cf37a3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.155863 Jul 27 08:42:07.638225 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 149/286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:07 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:08.659444 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:08.660130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:08.667549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:08.667995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:08.668756 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:08.669187 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:08.800274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:08.807949 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9876eb8b-676d-438b-828c-9e096c18ef3f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.152773 Jul 27 08:42:08.808513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 138/287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:08 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:08.830370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:08.830983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:08.838642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:08.839085 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:08.839847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:08.840279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:08.974589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:08.984818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-790220d1-8cfb-4466-93bf-df44f1b4d157 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1592 microversion: 2.1 time: 0.158667 Jul 27 08:42:08.985415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 150/288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:08 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1592 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:09.828897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:09.829601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:09.836770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:09.837211 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:09.838032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:09.838491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:09.974754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:09.982432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-65df9a20-1924-4995-b63b-ef06b64f2a37 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.157462 Jul 27 08:42:09.983004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 139/289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:09 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:11.005138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:11.006888 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:11.015323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:11.015776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:11.016551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:11.017204 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:11.172683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-4eca0ed4-3881-41cb-86c7-fe11f005c148 req-5e0b5c1f-de6c-4484-9404-e37197f6bf3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:11.188599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4eca0ed4-3881-41cb-86c7-fe11f005c148 req-5e0b5c1f-de6c-4484-9404-e37197f6bf3b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:11.189038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4eca0ed4-3881-41cb-86c7-fe11f005c148 req-5e0b5c1f-de6c-4484-9404-e37197f6bf3b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:11.203126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-4eca0ed4-3881-41cb-86c7-fe11f005c148 req-5e0b5c1f-de6c-4484-9404-e37197f6bf3b service nova] Creating event network-changed:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:42:11.208418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-4eca0ed4-3881-41cb-86c7-fe11f005c148 req-5e0b5c1f-de6c-4484-9404-e37197f6bf3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039911 Jul 27 08:42:11.209052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 140/290] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:11.241871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:11.249623 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-27b3a58f-b24b-43d3-a207-81c2fe0f4d5d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.249335 Jul 27 08:42:11.250254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 151/291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:10 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:12.272569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:12.273311 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:12.279632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:12.280115 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:12.280858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:12.281291 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:12.414607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:12.423043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-85c90d2b-c399-41d4-9964-3f38c8c7b87d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.154799 Jul 27 08:42:12.423811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 141/292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:12 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:13.444835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:13.445443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:13.451945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:13.452394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:13.453181 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:13.453616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:13.602202 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:13.609961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e20c02cb-97d6-41cd-b6b0-2aba87419cd3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.169092 Jul 27 08:42:13.610549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 152/293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:13 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:14.029056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1089187466"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:14.029593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:14.035805 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.036249 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.037004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.037569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.164429 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.network.security_group_api [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Adding security group ffe5ad9a-0397-4d7e-84ae-e9c69a18d94d to port 7246bf69-568f-45e6-aaee-ec190910b2b8 Jul 27 08:42:14.559196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a608c29a-dd32-4ddd-8759-8820d8824651 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.534043 Jul 27 08:42:14.560009 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 142/294] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:42:14 2022] POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:42:14.569440 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:14.570676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:14.584395 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.584879 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.586056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-d2487cc1-7303-4fbe-b1f2-4628436fc81e req-6516fd8c-fae2-41f2-8ba5-c0c6389d8083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:14.592557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.593025 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.605378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-d2487cc1-7303-4fbe-b1f2-4628436fc81e req-6516fd8c-fae2-41f2-8ba5-c0c6389d8083 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.605828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-d2487cc1-7303-4fbe-b1f2-4628436fc81e req-6516fd8c-fae2-41f2-8ba5-c0c6389d8083 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.628597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-d2487cc1-7303-4fbe-b1f2-4628436fc81e req-6516fd8c-fae2-41f2-8ba5-c0c6389d8083 service nova] Creating event network-changed:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:42:14.639661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-d2487cc1-7303-4fbe-b1f2-4628436fc81e req-6516fd8c-fae2-41f2-8ba5-c0c6389d8083 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065368 Jul 27 08:42:14.640866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 143/295] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:14.646643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:14.648207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:14.655774 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.656443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.657319 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:14.657814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:14.778578 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:14.793259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-92f1b7a5-9c1f-4eca-843c-bae8e3793da3 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1758 microversion: 2.1 time: 0.227784 Jul 27 08:42:14.794409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 153/296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:14 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:14.891686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:14.900794 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1d575e9a-0e49-4646-a624-6a791f4dc9d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.258404 Jul 27 08:42:14.901732 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 144/297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:14 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:15.923450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:15.924056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:15.931126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:15.931574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:15.932335 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:15.932768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:15.936921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:16.061146 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:16.068431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bde845e2-4c43-412d-a2d6-8520e7b2e6b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.148867 Jul 27 08:42:16.068988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 154/298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:15 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:17.089447 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:17.090053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:17.096031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:17.096477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:17.097224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:17.097652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:17.113035 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:17.230994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:17.238228 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-720fac43-0a55-4f82-8cf1-10f98c658418 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.153293 Jul 27 08:42:17.238783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 145/299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:17 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:18.259672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:18.260276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:18.266774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:18.267218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:18.267974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:18.268400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:18.404584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:18.412240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-058f9355-daad-45c1-98ef-2e94264de7d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.156879 Jul 27 08:42:18.412799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 155/300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:18 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:19.434689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:19.435219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:19.441248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:19.441697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:19.442489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:19.442927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:19.568305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:19.576094 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1aeb4a2f-c748-41d7-9fe9-d984d3c8ff93 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.145401 Jul 27 08:42:19.576661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 146/301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:19 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:20.596594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:20.597192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:20.603924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:20.604372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:20.605120 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:20.605546 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:20.732788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:20.740179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c974090c-19e1-45f1-8d92-9facef33102c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.147454 Jul 27 08:42:20.740741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 156/302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:20 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:20.890928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:20.891486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:20.897616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:20.898073 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:20.898886 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:20.899321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:20.924024 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-945f1434-c836-44a9-b55c-8cdf3919808e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/ips" status: 200 len: 152 microversion: 2.20 time: 0.036976 Jul 27 08:42:20.924596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 147/303] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Jul 27 08:42:20 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:42:21.761474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:21.762009 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:21.768692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:21.769143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:21.769902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:21.770375 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:21.898117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:21.905927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1daec490-4ceb-474b-a063-504a69a2d264 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.148991 Jul 27 08:42:21.908608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 157/304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:21 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:22.927039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:22.927652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:22.933728 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:22.934204 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:22.935112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:22.935586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:23.068882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:23.076485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d99e335b-d2d8-4894-8fe3-beb2af273613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.153538 Jul 27 08:42:23.077043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 148/305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:22 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:24.098579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:24.099220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.106539 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.106985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.107760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.108200 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.137227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:24.138050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.145369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.145989 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.146806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.147244 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.172708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lazy-loading 'flavor' on Instance uuid 73303fae-c87c-4ca8-86ef-f53a66bb47d9 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:42:24.247597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:24.255043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-49e46f8c-9864-45dd-b37b-3016c39b4cac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1501 microversion: 2.1 time: 0.160522 Jul 27 08:42:24.255605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 158/306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:24 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:24.275697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "726594d9-fbaf-4048-8bbd-8c8229246efd"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:24.278448 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.284635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.285070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.286027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.286629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.313971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] HTTP exception thrown: Cannot 'attach_volume' instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 while it is in vm_state rescued Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Request method failure captured: Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/os-volume_attachments HTTP/1.1 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 74 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Poed2m8e69flYFSd76bDHPzFAvbBDz0NIQR3bxJyeHiUTQgRCTQdAXpdTUjnKoFDkAxZcZu6KtweqBZXFLCVqFIB3aX8t6QKBeIJdbiN9TH1b85l_SdtoABrHNSrLo-vVUjPGn4ojSiltHh4kdxwRf4Nwzge37SZIWDqEmRqOTYGzs Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:42:24.315679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0d880114866423480268022d7dd20c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0d880114866423480268022d7dd20c5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 906ca078a25447b3b9c01f4fc76e7090 Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {"volumeAttachment": {"volumeId": "726594d9-fbaf-4048-8bbd-8c8229246efd"}} Jul 27 08:42:24.317090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Cannot 'attach_volume' instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 while it is in vm_state rescued Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'server_id': 'ac824ac8-4d92-4c41-8a17-c96d40d2ce05', 'body': {'volumeAttachment': {'volumeId': '726594d9-fbaf-4048-8bbd-8c8229246efd'}}} Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:42:24.317832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 while it is in vm_state rescued Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:42:24.319203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 while it is in vm_state rescued Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Returning 409 to user: Cannot 'attach_volume' instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 while it is in vm_state rescued {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fdcb1f07-1c71-4713-b418-7bf14d57a4e0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045509 Jul 27 08:42:24.320314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 159/307] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:42:24 2022] POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 08:42:24.325938 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:24.326501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.332651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.333222 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.333836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.334298 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.566102 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b916c821-0cf7-45ed-a0cc-c1c92c265c39 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/action" status: 202 len: 0 microversion: 2.1 time: 0.243758 Jul 27 08:42:24.566763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 160/308] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:42:24 2022] POST /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:42:24.575455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:24.576044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.582660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.583106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.583884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.584324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.609584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-40919287-a3dc-4ac7-8916-c2448a71e77c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/ips" status: 200 len: 144 microversion: 2.1 time: 0.038504 Jul 27 08:42:24.610341 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 161/309] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:42:24 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:24.614471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:24.615145 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.622436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.622889 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.623664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.624099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.643254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-054ad493-1372-4f30-95c6-e4e261ba5516 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/action" status: 202 len: 0 microversion: 2.20 time: 0.510024 Jul 27 08:42:24.644064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 149/310] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Jul 27 08:42:24 2022] POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 08:42:24.654920 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:24.655902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:24.663120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.663883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.664356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:24.664802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:24.770959 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:24.779997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ce497972-ad0d-4400-bfdd-a25f23649112 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1509 microversion: 2.1 time: 0.168828 Jul 27 08:42:24.780615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 162/311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:24 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:24.844088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:24.852024 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:24.853537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:24.855119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6b7e0df2-38ad-4126-bbba-3101548a3aad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.206377 Jul 27 08:42:24.855684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 150/312] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:24 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:25.192939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:25.193453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:25.200642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.201087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.201851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.202320 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.225875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a4fdad44-1f74-4bcc-8c26-af47ce9b353b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/ips" status: 200 len: 151 microversion: 2.1 time: 0.036861 Jul 27 08:42:25.226479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 163/313] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:42:25 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:25.807081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:25.807688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:25.814281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.814726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.815483 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.815918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.878971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:25.879764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:25.894458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.896034 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.896622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:25.898506 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:25.982004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:25.989788 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-376bdb70-715e-4b87-8994-908bd71a6e26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1509 microversion: 2.1 time: 0.186475 Jul 27 08:42:25.995021 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 151/314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:25 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:26.055321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:26.063549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:26.065130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:26.066301 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-367e5d44-2fd1-4ca7-a63f-d044a6a358e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.191555 Jul 27 08:42:26.066857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 164/315] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:25 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:27.011668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:27.012294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:27.018339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:27.018804 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:27.019565 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:27.019999 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:27.088896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:27.089577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:27.096385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:27.096723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:27.097490 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:27.097922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:27.149634 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:27.157642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0378ea95-184f-4f79-b662-4df7f25de81f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1509 microversion: 2.1 time: 0.149784 Jul 27 08:42:27.158248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 152/316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:27 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:27.228570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:27.237036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:27.238565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:27.239715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-75577671-64a6-41b1-a430-dd2c09d5b611 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.154760 Jul 27 08:42:27.240270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 165/317] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:27 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:28.059391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4818ec6c-8f1a-4580-a391-ca414406e3ba"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:28.061820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:28.067843 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.068286 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.069047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.069477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.179691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:28.180288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:28.187590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.188234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.188997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.189431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.323161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:28.331493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-83e8b9d2-a294-4c57-bc7d-b503adf558f0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1509 microversion: 2.1 time: 0.155706 Jul 27 08:42:28.332393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 166/318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:28 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:28.336774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:28.337414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:28.343697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.344143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.348894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.348894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.476643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:28.484581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:28.486095 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:28.487276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-dc105696-8023-45f2-9a10-ce6666d53766 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.154130 Jul 27 08:42:28.487829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 167/319] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:28 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:28.492410 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59f1fe16-3a91-4fef-b28a-f379342cf43f"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:28.494772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:28.500523 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.500971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:28.501730 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:28.502180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:29.549308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-72088089-92c4-4c5a-960b-1006a818e3a6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.493855 Jul 27 08:42:29.550198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 153/320] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:42:28 2022] POST /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments => generated 194 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:29.555422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:29.556126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:29.563094 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:29.563554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:29.564639 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:29.564760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:29.684768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e11b077e-ffe4-452f-99f6-e4696d370146 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.195698 Jul 27 08:42:29.685561 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 168/321] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:42:28 2022] POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments => generated 194 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:29.691064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:29.691985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:29.699293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:29.699743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:29.700658 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:29.701076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:29.705214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:29.723145 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:29.728093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-41ec556e-22e2-4a41-ac8b-9e4ddf1bad36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1515 microversion: 2.1 time: 0.176784 Jul 27 08:42:29.728674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 154/322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:29 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:29.843279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:29.851597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:29.853169 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:29.858612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1eaa0415-f2d3-44af-a0dd-cffbf8b716bc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.167565 Jul 27 08:42:29.858612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 169/323] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:29 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:30.878640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:30.879248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:30.885635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:30.886803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:30.887574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:30.888013 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:31.015443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:31.023266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:31.024772 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:31.025953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c4ff9cfc-d5b2-47cf-90e1-5d168fa43271 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.151206 Jul 27 08:42:31.027106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 155/324] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:30 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:31.517132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7df504db-acd5-4355-be27-cab501a1d488 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: .version_select at 0x7f78f0deb3a0>, body: {"keypair": {"name": "tempest-keypair-1309767652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKzBj7R8D5Q8d+isrtQB0jaV0phIr6jcjrJJsmy79+GHcs09IXlVgU7P8GpyIXqWSbcO0eaoV7jwUkDiYQYZe3ToXXqbPkiR6PMKIRyAqPX0eSg9ZoKmGWe++8yNFsQEw=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:31.528965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-7df504db-acd5-4355-be27-cab501a1d488 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for project a0d880114866423480268022d7dd20c5. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:42:31.532873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-7df504db-acd5-4355-be27-cab501a1d488 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for user 906ca078a25447b3b9c01f4fc76e7090 and project a0d880114866423480268022d7dd20c5. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:42:31.649197 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7df504db-acd5-4355-be27-cab501a1d488 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141021 Jul 27 08:42:31.649789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 170/325] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:42:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:32.049715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:32.050549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:32.057926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:32.058508 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:32.059719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:32.060396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:32.224028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:32.232212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:32.233708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:32.234883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3d8b8160-49f0-4e48-bde1-f929446e24a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.189115 Jul 27 08:42:32.235444 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 156/326] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:32 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:33.258671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:33.259540 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:33.267652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:33.268092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:33.268856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:33.269286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:33.401573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:33.409997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:33.411537 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:33.412686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-eb927221-3e86-49d9-b95a-74e3a95e169d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.159594 Jul 27 08:42:33.413240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 171/327] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:33 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:33.939954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-218879118", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0a6cf88-547f-4cf8-ad21-f8b392f1c474"}], "security_groups": [{"name": "tempest-securitygroup--1978411535"}], "key_name": "tempest-keypair-1309767652", "user_data": "}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:34.045213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] validate_networks() for [('d0a6cf88-547f-4cf8-ad21-f8b392f1c474', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:42:34.224097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=44 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:34.413091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:42:34.413534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:42:34.414007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:42:34.414449 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:42:34.414885 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:42:34.423903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:34.424343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:34.425141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:34.425603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:34.436608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:34.437288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:34.442398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:42:34.443894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:34.444376 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:34.445195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:34.445632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:34.446426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Getting quotas for user 906ca078a25447b3b9c01f4fc76e7090 and project a0d880114866423480268022d7dd20c5. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:42:34.458369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:42:34.460615 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:42:34.578328 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:34.586731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:34.588276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:34.589424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-98342fa2-a97b-4e92-ab09-2f1cea5a90f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.157183 Jul 27 08:42:34.589995 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 172/328] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:34 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:34.593167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c0e396dc-6e81-4262-9605-f9a09dc3e611 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.657354 Jul 27 08:42:34.595054 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 157/329] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:42:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 08:42:34.610935 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-65797b77-8066-4cca-a767-02e9ef58b773 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:34.611592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-65797b77-8066-4cca-a767-02e9ef58b773 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:34.663880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-65797b77-8066-4cca-a767-02e9ef58b773 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:34.672814 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-65797b77-8066-4cca-a767-02e9ef58b773 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1245 microversion: 2.1 time: 0.067561 Jul 27 08:42:34.673672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 173/330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:34 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:35.613412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:35.614020 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:35.620781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:35.621322 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:35.622014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:35.622484 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:35.692765 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:35.693383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:35.700329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:35.700789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:35.701568 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:35.702008 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:35.754003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:35.762269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:35.763960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:35.765382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6f4e168f-8a28-4e60-8ca7-5e8e28e2f062 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.156287 Jul 27 08:42:35.765984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 158/331] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:35 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:35.768071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:35.775630 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d8d65227-01cf-4cc9-8de9-5601809e701e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1249 microversion: 2.1 time: 0.086738 Jul 27 08:42:35.776273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 174/332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:35 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:36.788493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:36.789104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:36.796439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:36.796893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:36.797635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:36.798107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:36.798107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:36.798444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:36.805049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:36.805525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:36.806420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:36.806857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:36.868178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:36.877464 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b1a295c5-5386-4b07-be6e-2e08b7726a18 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1297 microversion: 2.1 time: 0.084253 Jul 27 08:42:36.878039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 175/333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:36 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:36.931470 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:36.933629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:36.940728 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:36.942283 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:36.943439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-da1ec07b-fdba-447e-8ea0-4bc390cec86d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.158881 Jul 27 08:42:36.944012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 159/334] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:36 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:37.898349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:37.898944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:37.901278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:37.906162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:37.906632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:37.907399 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:37.907835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:37.966887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:37.968212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:37.972275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:37.975657 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:37.976098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:37.977176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:37.977605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:37.981277 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9af00c8d-ca58-4925-9e38-68c8f74443df tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1305 microversion: 2.1 time: 0.086604 Jul 27 08:42:37.982117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 176/335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:37 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:38.148942 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f8eb4b62-6ba9-4f56-94ee-66ac0916a7ef tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: .version_select at 0x7f78f0e48b80>, body: {"keypair": {"name": "tempest-keypair-1208439677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZtfodjNrF3nlz6a+1tdjifBnUhWJCQ9AsXo2utd9997qt5XBAhKzPLwfVQHjRwR3DZfnNc7xJ2YZh+oYFW+HvPpe6vFTro1CB67pXRtwxCZyqXc1GMM52wrJWF17NUjw=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:38.165577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-f8eb4b62-6ba9-4f56-94ee-66ac0916a7ef tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:42:38.170104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-f8eb4b62-6ba9-4f56-94ee-66ac0916a7ef tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:42:38.197449 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:38.212666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:38.214362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:38.215877 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-74c758c3-0dff-46df-b6ea-4dd5c4d81a5c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.253831 Jul 27 08:42:38.216604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 160/336] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:37 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:38.270784 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f8eb4b62-6ba9-4f56-94ee-66ac0916a7ef tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126355 Jul 27 08:42:38.271311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 177/337] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:42:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:42:39.009281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:39.009915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:39.017329 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:39.017624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:39.018422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:39.019231 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:39.241203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:39.241983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:39.249740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:39.250304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:39.261228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:39.261680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:39.429541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:39.438324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:39.439941 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:39.441261 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fad46890-d2d7-4860-ba01-e7db1d28dcfb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.204021 Jul 27 08:42:39.441817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 178/338] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:39 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:39.460533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:39.468561 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b008d322-4696-4c30-8df4-5a1fe5d7858c tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.463130 Jul 27 08:42:39.474764 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 161/339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:39 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:40.465564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:40.466196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:40.472388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-5c6015e4-10f7-4252-8ee1-c922103903d4 req-f432f448-b5bf-403c-a8f7-70c600ba10b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:40.478653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:40.482414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:40.482414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:40.482414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:40.488914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5c6015e4-10f7-4252-8ee1-c922103903d4 req-f432f448-b5bf-403c-a8f7-70c600ba10b7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:40.489653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5c6015e4-10f7-4252-8ee1-c922103903d4 req-f432f448-b5bf-403c-a8f7-70c600ba10b7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:40.504995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-5c6015e4-10f7-4252-8ee1-c922103903d4 req-f432f448-b5bf-403c-a8f7-70c600ba10b7 service nova] Creating event network-changed:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:42:40.511636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-5c6015e4-10f7-4252-8ee1-c922103903d4 req-f432f448-b5bf-403c-a8f7-70c600ba10b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047554 Jul 27 08:42:40.521501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 162/340] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:40.527602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:40.528453 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:40.535944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:40.536514 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:40.537419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:40.537961 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:40.703796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:40.713282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:40.715067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:40.716308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-74e7b355-48a1-4483-bd92-cb0a458cb966 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.255367 Jul 27 08:42:40.717194 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 179/341] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:40 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:40.771101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:40.779005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-70ee8f51-71f8-4295-b0cd-103fe2034246 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.256042 Jul 27 08:42:40.780918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 163/342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:40 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:40.854892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-369140523", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f6980da-175b-4e92-9032-637e0458eb4f"}], "security_groups": [{"name": "tempest-securitygroup--2033065390"}], "key_name": "tempest-keypair-1208439677", "user_data": "}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:40.963140 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] validate_networks() for [('8f6980da-175b-4e92-9032-637e0458eb4f', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:42:41.331727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:42:41.332250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:42:41.332795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:42:41.333197 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:42:41.333599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:42:41.342423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.343983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:41.343983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.344241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:41.361432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:42:41.365643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:42:41.377814 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:42:41.380229 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:42:41.528254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [c0916553-c395-4014-ac70-0352e17d1db1] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 08:42:41.740491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:41.741098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:41.747590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.748525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:41.749292 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.749743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:41.876784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:41.884589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:41.886093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:41.887263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7cd2ae7b-31c1-46b9-abf7-43e1318c7949 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.150745 Jul 27 08:42:41.887812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 164/343] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:41 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:41.892250 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:41.892857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:41.898895 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.904331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:41.904331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:41.904331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:42.031148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:42.038465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-accf6c9f-c2d2-4b2d-9667-87eea06b301d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.149670 Jul 27 08:42:42.039026 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 165/344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:41 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:42.535526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [c0916553-c395-4014-ac70-0352e17d1db1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37546. Jul 27 08:42:42.539641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-eeb8d2b7-b249-4eaf-8884-f3ce06772a4f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.689345 Jul 27 08:42:42.540377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 180/345] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:42:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:42:42.551747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-77115540-b5b6-40e6-8e60-fe01f92e523f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:42.552603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-77115540-b5b6-40e6-8e60-fe01f92e523f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:42.608716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-77115540-b5b6-40e6-8e60-fe01f92e523f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:42.616331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-77115540-b5b6-40e6-8e60-fe01f92e523f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1241 microversion: 2.1 time: 0.068485 Jul 27 08:42:42.616891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 166/346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:42 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:42.912250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:42.912975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:42.919450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:42.919935 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:42.920843 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:42.921289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:43.049616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:43.058502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:43.059054 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:43.059530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:43.059684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:43.060994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-531bc7a6-dc3e-4067-926b-0dc8c8577763 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.152163 Jul 27 08:42:43.061677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 181/347] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:42 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:43.069596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:43.070047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:43.071114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:43.071614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:43.199842 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:43.208305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-27b691f1-12e6-4ac5-81a8-b2fe3094cdac tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.153280 Jul 27 08:42:43.208876 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 167/348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:43 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:43.637074 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:43.637622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:43.644976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:43.645420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:43.646210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:43.646647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:43.710872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:43.719235 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a79fbb80-3826-4c95-a45e-bd438d6a3932 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1245 microversion: 2.1 time: 0.086099 Jul 27 08:42:43.719810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 182/349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:43 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:44.085014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:44.085645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:44.092325 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.092763 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.093513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.093940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.223808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:44.228728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:44.229332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:44.232891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:44.234422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:44.235576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6449f865-00a9-4c07-909f-143ba0b00a5f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.154688 Jul 27 08:42:44.235901 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.236121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 168/350] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:44 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:44.236345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.237098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.237527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.370539 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:44.379076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9041b62d-b64d-446a-a821-7a981af2db58 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.153990 Jul 27 08:42:44.379771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 183/351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:44 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:44.739924 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:44.740649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:44.742591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:44.747457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.747922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.748828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:44.749262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:44.808517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:44.815713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3f333966-d42f-4853-a30a-2552b6c1366a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1245 microversion: 2.1 time: 0.079608 Jul 27 08:42:44.816287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 169/352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:44 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:45.258476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:45.259086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:45.266572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.267027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.267796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.268234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.395326 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:45.400010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:45.400647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:45.403552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:45.406563 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:45.406563 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2415c2e-b5a7-43d3-b57a-341cfbae778a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.151794 Jul 27 08:42:45.406966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 184/353] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:45 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:45.407118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.407553 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.408318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.408749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.538839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:45.546965 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d3f5aa53-03c3-46ab-b2c9-03c1a33b83ec tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.150224 Jul 27 08:42:45.547524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 170/354] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:45 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:45.836890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:45.841834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:45.843961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.844415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.845218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:45.845740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:45.916246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:45.920566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c03e87b9-2011-4883-bb8f-dd349c95f743 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1293 microversion: 2.1 time: 0.087942 Jul 27 08:42:45.921138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 185/355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:45 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:46.036250 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-04696771-cc69-437d-9c78-5be533c8e185 req-1b7df1f2-2528-4bd2-98d8-3e6016e1f457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "name": "network-vif-plugged", "status": "completed", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:46.046861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-04696771-cc69-437d-9c78-5be533c8e185 req-1b7df1f2-2528-4bd2-98d8-3e6016e1f457 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.047572 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-04696771-cc69-437d-9c78-5be533c8e185 req-1b7df1f2-2528-4bd2-98d8-3e6016e1f457 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.058828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-04696771-cc69-437d-9c78-5be533c8e185 req-1b7df1f2-2528-4bd2-98d8-3e6016e1f457 service nova] Creating event network-vif-plugged:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:42:46.064533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-04696771-cc69-437d-9c78-5be533c8e185 req-1b7df1f2-2528-4bd2-98d8-3e6016e1f457 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Jul 27 08:42:46.065125 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 171/356] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:46.430470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:46.431053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:46.438019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.444013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.444013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.444013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.569316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:46.572608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:46.574527 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:46.580946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.581761 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.588535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.588535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.588763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:46.588763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:46.588763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bc70acf8-80ab-45b8-82e0-1a86b04035f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.159516 Jul 27 08:42:46.589065 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 186/357] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:46 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:46.775524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:46.783807 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-09f5834f-3caa-45d6-a4bf-a91eba9f16cb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.219082 Jul 27 08:42:46.784908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 172/358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:46 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:46.804892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7e789140-79f8-4833-9f90-b9b8f92bb65e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:46.811041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7e789140-79f8-4833-9f90-b9b8f92bb65e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.811484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7e789140-79f8-4833-9f90-b9b8f92bb65e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.873381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7e789140-79f8-4833-9f90-b9b8f92bb65e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Going to try to stop instance {{(pid=129921) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 08:42:46.943421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:46.944092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:46.950386 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.950847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:46.952037 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:46.952147 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.016285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:47.024467 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3c18478a-0761-4bd8-9bd1-5a0c0628209e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1311 microversion: 2.1 time: 0.085076 Jul 27 08:42:47.025039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 173/359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:46 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:47.080948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7e789140-79f8-4833-9f90-b9b8f92bb65e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action" status: 202 len: 0 microversion: 2.1 time: 0.279775 Jul 27 08:42:47.082138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 187/360] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:42:46 2022] POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:42:47.090244 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:47.090891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:47.097044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.097486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.098278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.098711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.284179 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:47.292430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-538dc00e-f32b-4fb2-8036-1f223f6458e6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.206213 Jul 27 08:42:47.293260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 174/361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:47 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:47.610579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:47.611280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:47.621192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.621192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.621192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.621192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.753631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:47.757100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:47.761814 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:47.763336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:47.764505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b3867634-8c27-4ec6-a539-c470aacb34e6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.158973 Jul 27 08:42:47.765715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 188/362] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:47 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:42:47.805354 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:47.806232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:47.813866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.813866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.814846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:47.815387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:47.992699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:48.001375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-12eb57f9-6f9a-40bb-a7c5-e0e6d075dc7a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.200072 Jul 27 08:42:48.002037 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 175/363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:47 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:48.045421 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:48.046070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:48.053084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.053526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.054328 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.054780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.192016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:48.199428 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7a52635f-9d3a-426a-b2e0-462a0db9ffdd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.158394 Jul 27 08:42:48.200080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 189/364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:48 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:48.314643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:48.315263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:48.322697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.323152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.323963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.324400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.532482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:48.540375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9c1e7ea4-bb2e-488e-96cf-e7a4a3561cfd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.230109 Jul 27 08:42:48.540938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 176/365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:48 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:48.705423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-9bedc688-641d-4e7a-b47a-5373b38c6b43 req-82ed820f-da1a-4adb-9fe2-bccd1998fdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c4e570-1a1e-48ce-a477-0c84bcec9fbc", "tag": "3dc911f5-2c16-4531-acf6-43762dc287c7"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:48.731498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9bedc688-641d-4e7a-b47a-5373b38c6b43 req-82ed820f-da1a-4adb-9fe2-bccd1998fdc3 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.732569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9bedc688-641d-4e7a-b47a-5373b38c6b43 req-82ed820f-da1a-4adb-9fe2-bccd1998fdc3 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.746044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-9bedc688-641d-4e7a-b47a-5373b38c6b43 req-82ed820f-da1a-4adb-9fe2-bccd1998fdc3 service nova] Creating event network-changed:3dc911f5-2c16-4531-acf6-43762dc287c7 for instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc on hv-cinder-85117 Jul 27 08:42:48.751544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-9bedc688-641d-4e7a-b47a-5373b38c6b43 req-82ed820f-da1a-4adb-9fe2-bccd1998fdc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055510 Jul 27 08:42:48.752294 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 190/366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:48.788842 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:48.789688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:48.793890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-3b2850ca-e272-4307-81f6-9f7b468fb3a3 req-6c8ede0b-165a-4763-957f-8ed6bc5ec790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "name": "network-vif-plugged", "status": "completed", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:48.796440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.797058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.801263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.801263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.804929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-3b2850ca-e272-4307-81f6-9f7b468fb3a3 req-6c8ede0b-165a-4763-957f-8ed6bc5ec790 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:48.805358 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-3b2850ca-e272-4307-81f6-9f7b468fb3a3 req-6c8ede0b-165a-4763-957f-8ed6bc5ec790 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:48.817143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-3b2850ca-e272-4307-81f6-9f7b468fb3a3 req-6c8ede0b-165a-4763-957f-8ed6bc5ec790 service nova] Creating event network-vif-plugged:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:42:48.824143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-3b2850ca-e272-4307-81f6-9f7b468fb3a3 req-6c8ede0b-165a-4763-957f-8ed6bc5ec790 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034413 Jul 27 08:42:48.824930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 191/367] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:42:49.022899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:49.023848 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:49.030250 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.030738 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.031520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.031951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.049043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.057892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.059675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.060929 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-979fe531-7845-490a-9177-385595a046f6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.276283 Jul 27 08:42:49.061692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 177/368] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:48 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:49.163108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.170780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e04268ed-cf92-4e4a-9028-82faef120644 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.151964 Jul 27 08:42:49.171401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 192/369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:49 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:49.220408 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:49.221017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:49.227445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.227887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.228827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.229262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.358325 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.362086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:49.367020 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a188a67e-a199-4cf0-9d78-8ab8056a8e33 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.150495 Jul 27 08:42:49.367585 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 178/370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:49 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:49.563199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:49.563792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:49.569751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.570218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.570972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:49.571402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:49.700463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:49.708757 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fdd5f750-fb1a-4eb5-9b98-d8a6ad99380c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.149981 Jul 27 08:42:49.709327 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 193/371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:49 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:50.085502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:50.086101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:50.093016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.094060 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.094835 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.095263 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.192263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:50.192990 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:50.199504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.200040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.200882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.201430 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.226465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.235604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.237334 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.238464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a5ae4707-1173-491e-b44f-d5f06b8610a0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1746 microversion: 2.20 time: 0.157055 Jul 27 08:42:50.239220 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 179/372] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:50 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:50.330618 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.339997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b3034ecd-8771-404d-8e3d-b56e91926bd6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1371 microversion: 2.1 time: 0.150085 Jul 27 08:42:50.339997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 194/373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:50 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:50.387343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:50.387980 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:50.395205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.395651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.396408 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.396846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.523859 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.531261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-94b6c07f-fdb7-45f3-8f45-f8661b0b709c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.147794 Jul 27 08:42:50.531812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 180/374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:50 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:50.731352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:50.732102 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:50.738414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.739184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.739959 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:50.740393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:50.869860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:50.878400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4fada233-a05c-425a-a50e-e1c83273b735 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.150937 Jul 27 08:42:50.878964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 195/375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:50 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:51.261391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:51.262213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:51.268958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.269413 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.270288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.270735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.359998 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:51.361142 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:51.363594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:51.368372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.368820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.369588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.370022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.373948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=16 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:51.401980 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:51.410841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:51.412942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:51.413633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7aa4e1c2-2088-4bd0-944e-9ebad324e3f4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.156292 Jul 27 08:42:51.414266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 181/376] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:51 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:51.505345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:51.513187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-396add64-be54-4d18-864e-bf623dbfd8fb tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1564 microversion: 2.1 time: 0.156972 Jul 27 08:42:51.514240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 196/377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:51 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:42:51.538031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:51.539552 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:51.546704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.547440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.550451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.553318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.554604 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:51.555521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:51.568987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.568987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.568987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.568987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.717444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:51.725641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-42da089e-3084-4076-87eb-6ba588ad61fd tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.177456 Jul 27 08:42:51.726913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 197/378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:51 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:51.789139 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d160ef92-2766-4ec8-bf56-57d9301374a2 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.258587 Jul 27 08:42:51.789892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 182/379] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:42:51 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:51.899650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:51.900359 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:51.906525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.907829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:51.908806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:51.909398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:52.147097 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:52.156711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-70e0b6f8-c668-41b1-bea1-eac820907349 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.260477 Jul 27 08:42:52.158997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 198/380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:51 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:52.439674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:52.440975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:52.448028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:52.448509 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:52.449282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:52.449720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:52.610789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:52.613571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=8 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:52.620983 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:52.624061 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:52.624742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7e1c7754-a46b-41bc-b44c-a32e3fa080de tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.189651 Jul 27 08:42:52.626268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 183/381] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:52 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:52.750055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:52.751244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:52.760474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:52.760915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:52.763348 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:52.764072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.180425 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:53.181721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:53.185742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:53.196816 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6d2534a3-76b1-4f3c-a232-1ceab0daa296 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.453720 Jul 27 08:42:53.197814 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 199/382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:52 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:53.204371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:53.205106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.206119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:53.207052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.412022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-0f5f98b1-4953-4415-9874-a3cb39e6cc49 req-ede18d0d-db66-4e07-9285-72717372d723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:53.433368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0f5f98b1-4953-4415-9874-a3cb39e6cc49 req-ede18d0d-db66-4e07-9285-72717372d723 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:53.434212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0f5f98b1-4953-4415-9874-a3cb39e6cc49 req-ede18d0d-db66-4e07-9285-72717372d723 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.446691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:53.452768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-0f5f98b1-4953-4415-9874-a3cb39e6cc49 req-ede18d0d-db66-4e07-9285-72717372d723 service nova] Creating event network-changed:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:42:53.459464 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-0f5f98b1-4953-4415-9874-a3cb39e6cc49 req-ede18d0d-db66-4e07-9285-72717372d723 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053746 Jul 27 08:42:53.460769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 200/383] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:42:53.460926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6d1d3334-401e-45a7-a42d-a6d8becdb453 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.285013 Jul 27 08:42:53.461493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 184/384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:53 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:53.649546 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:53.651174 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:53.658933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:53.659704 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.660651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:53.661246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:53.825552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:53.834484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:53.835973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:53.837562 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-260ed481-f0c6-4b03-be01-3a9ffdbfc064 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.192386 Jul 27 08:42:53.853657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 201/385] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:53 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:54.220907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:54.221848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:54.229918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.230649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:54.232842 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.233485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:54.394687 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:54.406494 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e50f32c4-472f-4d9b-b980-236f82978319 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.191090 Jul 27 08:42:54.408426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 185/386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:54 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:54.492406 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:54.493027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:54.504207 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.504672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:54.505559 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.505993 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:54.749812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:54.759972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f4658cc4-4b63-4532-b081-b76edc50951d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.280174 Jul 27 08:42:54.761451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 202/387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:54 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:54.861793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:54.862441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:54.872136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.872862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:54.873530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:54.874209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:55.126190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:55.134079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:55.135701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:55.136850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-bc8c3807-cee6-4d00-817d-5bc0c2f5cfad tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.279775 Jul 27 08:42:55.137581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 186/388] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:54 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:55.431189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:55.431797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:55.441336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:55.442383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:55.443340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:55.443885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:55.596745 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:55.607433 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-11fe4cff-e0a2-4134-9baa-d71dc5e751ba tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.181647 Jul 27 08:42:55.608351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 203/389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:55 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:55.784011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:55.784804 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:55.793323 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:55.793770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:55.794658 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:55.795098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:55.935104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:55.945081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c9bf8752-7550-419f-bbc7-cb0fc50921f1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.165041 Jul 27 08:42:55.958326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 187/390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:55 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:56.159973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:56.161015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:56.168488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.169260 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:56.170295 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.170968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:56.315259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:56.323859 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:56.325821 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:56.327052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-748c7a37-ca34-4fb3-aec7-c534c705b27c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.171073 Jul 27 08:42:56.342166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 204/391] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:56 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:56.629120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:56.629835 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:56.638424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.638944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:56.639998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.640502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:56.801918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:56.810547 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-22f35eb0-e94e-4f43-b47e-57903d050115 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.185645 Jul 27 08:42:56.812174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 188/392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:56 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:56.967549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:56.968153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:56.975651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.976384 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:56.977392 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:56.978048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:57.131728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:57.140885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-285e3216-af8b-4690-bd32-4937517b3bea tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.177186 Jul 27 08:42:57.142807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 205/393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:56 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:57.352758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:57.353372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:57.362004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:57.362588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:57.363558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:57.364145 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:57.504751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:57.514684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:57.517242 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:57.518505 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-94f0ef9b-616f-43a8-985d-0ce27a0aaaf8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.170779 Jul 27 08:42:57.519717 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 189/394] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:57 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:57.834153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:57.835753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:57.842590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:57.843229 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:57.844178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:57.845070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:57.999345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:58.011892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b511ea12-2e46-4c4f-9ece-3e6b42446f29 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.182872 Jul 27 08:42:58.012954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 206/395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:57 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:58.167355 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:58.168069 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:58.175377 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:58.175817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:58.176594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:58.177025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:58.319270 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:58.329335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fe82f126-4d29-43f8-ab86-3f7a155ecf8d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.165484 Jul 27 08:42:58.330025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 190/396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:58 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:58.545664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:58.546186 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:58.552330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:58.553913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:58.554709 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:58.555132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:58.574060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:42:58.687976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:58.696850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:58.707346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:58.707346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0b668948-ca70-4f92-8cbd-5a66d87dbb14 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.159446 Jul 27 08:42:58.707346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 207/397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:58 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:42:59.010748 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-ed04c2b7-b7db-44f8-bf6b-0994e6e9bc4a req-0824765c-92f7-4ec9-8024-a1f5ce9f677e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c4e570-1a1e-48ce-a477-0c84bcec9fbc", "name": "network-vif-plugged", "status": "completed", "tag": "3dc911f5-2c16-4531-acf6-43762dc287c7"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:42:59.023493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-ed04c2b7-b7db-44f8-bf6b-0994e6e9bc4a req-0824765c-92f7-4ec9-8024-a1f5ce9f677e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.024277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-ed04c2b7-b7db-44f8-bf6b-0994e6e9bc4a req-0824765c-92f7-4ec9-8024-a1f5ce9f677e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.033895 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:59.034596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:59.045510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.046344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.047320 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.050666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.056854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-ed04c2b7-b7db-44f8-bf6b-0994e6e9bc4a req-0824765c-92f7-4ec9-8024-a1f5ce9f677e service nova] Creating event network-vif-plugged:3dc911f5-2c16-4531-acf6-43762dc287c7 for instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc on hv-cinder-85117 Jul 27 08:42:59.064592 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-ed04c2b7-b7db-44f8-bf6b-0994e6e9bc4a req-0824765c-92f7-4ec9-8024-a1f5ce9f677e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058738 Jul 27 08:42:59.066096 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 191/398] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:42:59.225681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:59.233603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4f953462-a8b7-40a7-8479-7029e570951f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.203772 Jul 27 08:42:59.234189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 208/399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:59 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:59.355916 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:59.356968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:59.365123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.365584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.366458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.367054 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.580932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:59.591698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-93fda235-215e-4347-b029-b3a0331f9d7f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.240226 Jul 27 08:42:59.592458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 192/400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:42:59 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:42:59.724509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:42:59.725113 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:42:59.731275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.731718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.732486 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:42:59.732917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:42:59.872537 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:59.881428 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:59.882967 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:42:59.884151 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-26cd15bf-9596-4571-a915-8fc55cf0a84a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.163661 Jul 27 08:42:59.884711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 209/401] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:42:59 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:00.255746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:00.256413 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:00.262620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.263361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:00.264392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.264935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:00.405444 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:00.415218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8b2f4304-0ed9-42c7-91a1-38e0c68e13eb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.163260 Jul 27 08:43:00.415836 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 193/402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:00 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:00.617073 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:00.617667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:00.624194 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.624744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:00.626313 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.626966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:00.774381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:00.784748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-620be49a-4ae1-44c7-8a28-1b18a906e70f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.171415 Jul 27 08:43:00.785323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 210/403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:00 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:00.908318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:00.908945 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:00.916304 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.916790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:00.917560 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:00.918000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:01.082636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:01.091161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:01.092711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:01.093875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9596abde-4d32-4c44-80a4-fed7f452b9f1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.190404 Jul 27 08:43:01.110172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 194/404] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:00 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:01.436611 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:01.438219 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:01.444505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:01.444958 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:01.448665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:01.448665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:01.596027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:01.613360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5666cd27-38e8-4927-8e4e-ea5b953c83e9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1367 microversion: 2.1 time: 0.180488 Jul 27 08:43:01.614252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 211/405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:01 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:01.806832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:01.807492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:01.814475 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:01.814922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:01.815705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:01.816158 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:01.951379 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:01.959949 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-06ca47c6-c37c-4213-8be6-39b702cf50c8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.157356 Jul 27 08:43:01.960520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 195/406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:01 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:43:02.121586 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:02.122212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:02.138122 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.138597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.139380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.139815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.285505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:02.294928 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:02.296716 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:02.297746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-53811913-8f43-4e13-a9a8-253ec30a347e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.180055 Jul 27 08:43:02.313213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 212/407] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:02 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:02.634652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:02.635359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:02.644408 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.644867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.645682 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.646121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.662779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:02.789576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:02.796989 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a00b83a2-1e8e-457e-970f-850b2e7ba465 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1558 microversion: 2.1 time: 0.166143 Jul 27 08:43:02.797596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 196/408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:02 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:02.818465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:02.818945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:02.820857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:02.827123 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.827566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.828313 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.829222 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.914737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fcf56e31-a971-4efd-b59e-5f2b94d29d75 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099916 Jul 27 08:43:02.915328 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 213/409] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:43:02 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:43:02.980912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:02.981517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:02.988091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.988534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:02.989384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:02.989815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:03.126641 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:03.135222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d85db27f-d443-45cf-ae2f-0a647e4ed394 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.158179 Jul 27 08:43:03.135786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 197/410] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:02 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:03.320931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:03.321515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:03.327668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:03.328105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:03.329455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:03.329911 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:03.487206 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:03.495172 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:03.496674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:03.497820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-32df1c78-33eb-41f4-8e65-85a68d7a2172 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1741 microversion: 2.20 time: 0.181334 Jul 27 08:43:03.498397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 214/411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:03 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:03.929057 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-3d41bdd9-831c-484e-b57b-e81b8fc03d60 req-f3e838aa-0e06-4c27-95aa-843641ea1239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c4e570-1a1e-48ce-a477-0c84bcec9fbc", "tag": "3dc911f5-2c16-4531-acf6-43762dc287c7"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:03.939280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-3d41bdd9-831c-484e-b57b-e81b8fc03d60 req-f3e838aa-0e06-4c27-95aa-843641ea1239 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:03.939724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-3d41bdd9-831c-484e-b57b-e81b8fc03d60 req-f3e838aa-0e06-4c27-95aa-843641ea1239 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:03.951214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-3d41bdd9-831c-484e-b57b-e81b8fc03d60 req-f3e838aa-0e06-4c27-95aa-843641ea1239 service nova] Creating event network-changed:3dc911f5-2c16-4531-acf6-43762dc287c7 for instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc on hv-cinder-85117 Jul 27 08:43:03.956184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-3d41bdd9-831c-484e-b57b-e81b8fc03d60 req-f3e838aa-0e06-4c27-95aa-843641ea1239 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Jul 27 08:43:03.957114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 198/412] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:43:04.157807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:04.160816 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:04.164845 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:04.165363 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:04.166364 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:04.166878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:04.296883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:04.305460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fb2b8152-18cc-48db-bfd6-0b52e29c3e0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.152433 Jul 27 08:43:04.306007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 215/413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:04 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:04.523080 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:04.523677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:04.526627 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:04.531529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:04.532704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:04.533687 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:04.534121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:04.861675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:04.870161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:04.872033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:04.873392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f90ce449-fe4d-499d-af6a-fe076ca1ab57 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1723 microversion: 2.20 time: 0.354628 Jul 27 08:43:04.874199 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 199/414] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:04 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:05.327150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:05.327870 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:05.334615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:05.335052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:05.335799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:05.336226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:05.467687 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:05.476162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-62c4dc57-9720-4dd0-9750-175ad79d8809 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.152843 Jul 27 08:43:05.476726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 216/415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:05 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:05.897072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:05.897676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:05.904188 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:05.904642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:05.905396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:05.905834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:06.033362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:06.041235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:06.042792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:06.043939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-99c3c51d-7a2a-47a7-bce5-e28612161361 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1723 microversion: 2.20 time: 0.150878 Jul 27 08:43:06.044491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 200/416] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:05 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:06.497344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:06.497881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:06.505179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:06.505622 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:06.506427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:06.506853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:06.636165 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:06.644104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0fc73f1c-b197-4feb-9959-6e54029c8191 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.150666 Jul 27 08:43:06.644668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 217/417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:06 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:07.067387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:07.068087 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:07.074504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:07.074955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:07.075721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:07.076161 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:07.208241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:07.216262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:07.217822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:07.218994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b8f1a361-f38e-4f78-ba87-c00c186fe234 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1723 microversion: 2.20 time: 0.155715 Jul 27 08:43:07.220317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 201/418] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:07 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:07.665163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:07.665752 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:07.673045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:07.681336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:07.681336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:07.681336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:07.813701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:07.821868 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-72979821-7933-44d2-be32-762995de5401 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1721 microversion: 2.1 time: 0.160496 Jul 27 08:43:07.822389 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 218/419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:07 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:08.242296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:08.242960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:08.249479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.249927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.251587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.252031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.380855 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:08.388722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:08.390228 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:08.391466 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b84daf2c-898c-4358-82b8-15a67b4c1c1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1666 microversion: 2.20 time: 0.152967 Jul 27 08:43:08.392277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 202/420] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:08 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:08.414737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50166dc3-1157-4128-88e5-34b5dc4c213b"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:08.417221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:08.423980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.424425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.425181 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.425614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.844428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:08.845820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:08.851935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.858434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.858434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:08.858434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:08.991970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:09.000225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-45e48d24-1914-4040-8f83-2ec9746145af tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1698 microversion: 2.1 time: 0.159734 Jul 27 08:43:09.016643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 203/421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:08 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:43:09.016643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-e8a11807-cbe5-40be-be1e-6a63c50ae615 req-b113cf7f-e236-4c1d-bc7a-0effaabae54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:09.016643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e8a11807-cbe5-40be-be1e-6a63c50ae615 req-b113cf7f-e236-4c1d-bc7a-0effaabae54f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.016643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e8a11807-cbe5-40be-be1e-6a63c50ae615 req-b113cf7f-e236-4c1d-bc7a-0effaabae54f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.026881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.compute.server_external_events [req-e8a11807-cbe5-40be-be1e-6a63c50ae615 req-b113cf7f-e236-4c1d-bc7a-0effaabae54f service nova] Unable to find a host for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9. Dropping event network-vif-unplugged {{(pid=129924) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 08:43:09.027746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-e8a11807-cbe5-40be-be1e-6a63c50ae615 req-b113cf7f-e236-4c1d-bc7a-0effaabae54f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025391 Jul 27 08:43:09.028332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 204/422] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 08:43:09.032897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1ab75748-af20-49ca-8335-3b845b5f0a52 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:09.039014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1ab75748-af20-49ca-8335-3b845b5f0a52 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.039333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1ab75748-af20-49ca-8335-3b845b5f0a52 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.099273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1ab75748-af20-49ca-8335-3b845b5f0a52 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Going to try to start instance {{(pid=129924) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 08:43:09.228552 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1ab75748-af20-49ca-8335-3b845b5f0a52 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action" status: 202 len: 0 microversion: 2.1 time: 0.198972 Jul 27 08:43:09.229148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 205/423] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:43:09 2022] POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:43:09.238422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:09.239116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:09.245358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.246018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.248597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.248597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.378090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5cac766c-a803-4765-8a0e-5938eb117082 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.967014 Jul 27 08:43:09.379184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 219/424] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Jul 27 08:43:08 2022] POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 188 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:43:09.380106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:09.390883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-11002538-c85c-453b-977a-e2bf986b63ec tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1707 microversion: 2.1 time: 0.157123 Jul 27 08:43:09.391576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 206/425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:09 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:43:09.504586 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:09.505155 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:09.511181 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.511625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.512382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.512810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.653253 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:09.745673 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3f953052-ad19-44aa-94f5-bb14a9067ee5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/action" status: 202 len: 0 microversion: 2.20 time: 0.245137 Jul 27 08:43:09.747077 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 220/426] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Jul 27 08:43:09 2022] POST /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:43:09.754834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:09.755446 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:09.761504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.761959 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.762840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:09.763279 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:09.969856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:09.978643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:09.980201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:09.981356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c3d62574-2542-47bd-8a67-71697106a9e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1752 microversion: 2.20 time: 0.230434 Jul 27 08:43:09.981901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 207/427] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:09 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:10.413095 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:10.413740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:10.421817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:10.422305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:10.423103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:10.423536 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:10.556700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:10.564553 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-74423a91-7749-48ce-b160-f7866ee43cbf tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1707 microversion: 2.1 time: 0.155280 Jul 27 08:43:10.572520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 221/428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:10 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1707 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:11.005491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:11.006383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:11.013058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:11.013585 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:11.014391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:11.014825 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:11.144742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:11.154126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:11.155647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:11.156795 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f633c9a4-d33e-4b96-bcb5-59438d91782e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1752 microversion: 2.20 time: 0.156115 Jul 27 08:43:11.157702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 208/429] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:10 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:11.585633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:11.586470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:11.593176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:11.593617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:11.594407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:11.594871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:11.726960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:11.734963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b33a310a-bf34-4a7a-ac30-ca1e09dfbb01 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1711 microversion: 2.1 time: 0.153973 Jul 27 08:43:11.735516 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 222/430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:11 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:12.179610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:12.180270 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:12.186899 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:12.187345 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:12.188111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:12.188545 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:12.315782 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:12.324930 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:12.326449 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:12.327596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9a5fc6a3-1792-4d80-be93-0c63196090e7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1754 microversion: 2.20 time: 0.151983 Jul 27 08:43:12.328152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 209/431] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:12 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:13.352509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:13.353105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:13.359579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:13.360016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:13.360767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:13.361193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:13.486869 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:13.495522 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:13.497002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:13.498183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bd301176-6d1c-4155-9343-f1010769f9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.150465 Jul 27 08:43:13.498737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 223/432] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:13 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:14.521801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:14.526405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:14.529492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:14.529936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:14.530723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:14.531221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:14.664642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:14.673110 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:14.674705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:14.676465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-31901a79-7a82-486b-8235-63393012f1fc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.158306 Jul 27 08:43:14.677018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 210/433] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:14 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:15.699038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:15.699671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:15.706393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:15.706840 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:15.708088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:15.708485 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:15.843862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:15.853451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:15.854982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:15.856140 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1ad90b43-aec7-464d-89f4-e783cdd4c116 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.160966 Jul 27 08:43:15.856692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 224/434] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:15 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:16.879493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:16.880275 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:16.887110 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:16.887562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:16.888399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:16.888845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:17.027174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:17.036698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:17.038347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:17.039511 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a2a468bc-9e7b-4ef0-8cd4-0feffc5c92d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.164469 Jul 27 08:43:17.040093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 211/435] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:16 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:18.064209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:18.064977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:18.072894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:18.073567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:18.074459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:18.074927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:18.234176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:18.243239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:18.244423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:18.245589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-78332d91-3aa2-4515-adc9-a3ae057522cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.185394 Jul 27 08:43:18.246246 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 225/436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:18 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:19.270436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:19.271091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:19.277848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:19.278433 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:19.279210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:19.279658 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:19.413075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:19.421396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:19.423008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:19.424180 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-78308ea6-100c-472b-afa3-0d1005ef32df tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.157807 Jul 27 08:43:19.424758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 212/437] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:19 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:20.447641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:20.448403 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:20.455532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:20.456002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:20.456926 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:20.457355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:20.591420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:20.600502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:20.602276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:20.603425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a752ba7f-a2bc-473e-87ad-bfe94212e79e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.159653 Jul 27 08:43:20.603972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 226/438] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:20 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:21.627155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:21.627890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:21.634765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:21.635207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:21.635969 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:21.636400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:21.651837 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:21.997029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:22.005466 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:22.006998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:22.008160 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b681464d-b8b8-4a9b-81af-eed7832412cd tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.384968 Jul 27 08:43:22.008707 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 213/439] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:21 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:23.031654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:23.032351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:23.040131 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:23.040508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:23.041278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:23.041725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:23.179411 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:23.188142 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:23.189865 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:23.191134 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f8da1158-0897-44e7-a0a1-18035eba9e6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.163397 Jul 27 08:43:23.192285 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 227/440] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:23 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:24.214919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:24.215520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:24.221928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:24.222406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:24.224197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:24.224642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:24.358226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:24.367208 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:24.368700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:24.369858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a73fe888-8f4a-4bd0-b046-765ee2701f05 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.158870 Jul 27 08:43:24.370498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 214/441] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:24 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:25.394037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:25.395019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:25.401331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:25.401775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:25.402572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:25.403004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:25.545633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:25.558998 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:25.560640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:25.562053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5c488e47-4c32-4f2e-8061-fda4bda9a737 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.172130 Jul 27 08:43:25.562743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 228/442] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:25 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:26.295530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:26.297821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:26.305335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.305782 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.306566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.306995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.508577 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-870c458f-f710-4302-abc1-575c3c2d659d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.216751 Jul 27 08:43:26.509139 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 215/443] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:43:26 2022] POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:43:26.517238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:26.517849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:26.525178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.525625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.526425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.526919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.591673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:26.592590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:26.599856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.600307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.601075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:26.601502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:26.682343 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:26.690656 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7012890b-8117-456d-a3b3-10b468f914e0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.177136 Jul 27 08:43:26.691256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 229/444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:26 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:43:26.739642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:26.748585 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:26.750088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:26.751266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b70def64-8b21-49b3-9ab5-68d1bb3559e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.163813 Jul 27 08:43:26.751820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 216/445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:26 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:27.712281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:27.712894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:27.719580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:27.720086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:27.720814 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:27.721247 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:27.775103 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:27.775792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:27.783543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:27.784167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:27.785011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:27.785617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:27.864963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:27.872977 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5b977c4d-bf86-4436-bcc6-2127a7b4971d tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.165447 Jul 27 08:43:27.873532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 230/446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:27 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:27.915838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:27.924919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:27.926940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:27.928083 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ec2d5e90-15b3-4b81-ac5b-377f59e92b42 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.157008 Jul 27 08:43:27.928649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 217/447] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:27 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:28.895733 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:28.896336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:28.902988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:28.903429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:28.904171 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:28.904601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:28.951850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:28.952547 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:28.959377 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:28.959830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:28.960602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:28.961146 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:29.049988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:29.058191 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0ed376f0-d09d-40ed-96ed-20ec70947df1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.166821 Jul 27 08:43:29.058664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 231/448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:28 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:29.093847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:29.102326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:29.103834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:29.104982 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-49b9c88d-7fcb-4e43-9647-7b500cdba664 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.157304 Jul 27 08:43:29.105536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 218/449] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:28 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:30.079982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:30.080587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:30.088084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:30.088532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:30.089317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:30.089766 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:30.126591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:30.127198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:30.134352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:30.134803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:30.135572 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:30.136011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:30.232265 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:30.240915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-64f85a31-102f-4ab7-b8eb-ffa61a1ffe47 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.164804 Jul 27 08:43:30.241479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 232/450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:30 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:30.264947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:30.273936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:30.275459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:30.276603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-eeb692ea-9c38-4941-b482-bacf1abd50e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.153798 Jul 27 08:43:30.277156 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 219/451] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:30 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:31.261644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:31.262703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:31.268730 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:31.269177 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:31.270241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:31.270688 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:31.300264 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:31.301647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:31.309226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:31.309672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:31.310475 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:31.310908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:31.414917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:31.422797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d9864d05-004d-4e9e-ba74-6050a8f8bd0b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.164987 Jul 27 08:43:31.423365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 233/452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:31 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:31.444531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:31.450423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:31.451928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:31.453075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-76145d16-ee12-4ee3-b7f2-205d143c3965 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.156775 Jul 27 08:43:31.453653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 220/453] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:31 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:32.445824 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:32.446576 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:32.453043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:32.453519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:32.454321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:32.454755 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:32.477873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:32.479252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:32.486636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:32.489832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:32.489832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:32.498812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:32.609023 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:32.617483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c8693310-6984-4f20-9e99-a9a8912c3ebf tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1750 microversion: 2.1 time: 0.176576 Jul 27 08:43:32.618060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 234/454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:32 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:32.821734 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:32.830082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:32.831608 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:32.832762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-76894d48-bb4a-43a2-be60-c7f4d313b2c4 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.360374 Jul 27 08:43:32.833562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 221/455] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:32 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:33.638728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:33.639343 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:33.641857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=46 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:33.647513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:33.647997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:33.648988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:33.649425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:33.792455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:33.800365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b9dfaab1-4fc4-4410-9c80-4ac8758b099a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.165524 Jul 27 08:43:33.800938 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 235/456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:33 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:33.855801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:33.856397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:33.862907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:33.863350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:33.864105 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:33.864536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:33.992791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:34.001259 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:34.002772 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:34.003908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-34a1bad8-62ad-4d51-9e76-52e6994f0b51 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.151932 Jul 27 08:43:34.004455 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 222/457] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:33 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:34.821734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:34.822304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:34.828694 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:34.829135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:34.829884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:34.830339 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:34.971833 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:34.980229 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-53037f6f-a488-4be3-bb55-fa5b9e864e4a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.163029 Jul 27 08:43:34.980793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 236/458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:34 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:35.026922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:35.027530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:35.029919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=48 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:35.034689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:35.035136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:35.035887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:35.036323 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:35.161956 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:35.170953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:35.172454 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:35.173606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-16d64297-f1d1-400b-b9b6-7c1db4a41a35 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.150529 Jul 27 08:43:35.174225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 223/459] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:35 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:36.001374 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:36.001984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:36.008724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:36.009168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:36.009923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:36.010379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:36.027636 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:36.147877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:36.155768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-91b3883c-5374-4dff-add2-86982b8d1376 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.158258 Jul 27 08:43:36.156332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 237/460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:35 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:36.197022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:36.197629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:36.204267 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:36.204712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:36.205473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:36.205913 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:36.338691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:36.346954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:36.348436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:36.349575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-dd5428d9-75bf-4074-b468-47c5538b3b8b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.156679 Jul 27 08:43:36.350273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 224/461] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:36 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:37.177176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:37.177772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:37.184237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:37.184675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:37.185424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:37.185852 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:37.327112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:37.335876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6d10aa81-c94a-465a-8bbb-80435b389a5b tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.162550 Jul 27 08:43:37.336431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 238/462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:37 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:37.372225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:37.372833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:37.379352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:37.379806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:37.380571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:37.381014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:37.504986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:37.515889 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:37.517378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:37.518562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a47b8e42-308f-4232-a9df-e2edc4035fb7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.150233 Jul 27 08:43:37.519118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 225/463] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:37 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:38.357294 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:38.357903 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:38.364359 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:38.364802 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:38.365806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:38.366447 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:38.506678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:38.514530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9f47a4c3-ba61-4981-94a9-26be0a3d5fa1 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.161156 Jul 27 08:43:38.515091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 239/464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:38 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:38.541579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:38.542216 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:38.548712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:38.549165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:38.549936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:38.550403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:38.682461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:38.690751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:38.692245 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:38.693394 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f0315e78-44f5-48fb-bcf7-cf2020cd273a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.156589 Jul 27 08:43:38.694162 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 226/465] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:38 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:39.535882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:39.536513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:39.543610 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:39.544056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:39.544811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:39.545241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:39.683360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:39.691312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a4eea65a-9025-4be8-9b55-57cd915e6864 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.159320 Jul 27 08:43:39.691871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 240/466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:39 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:39.716801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:39.717404 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:39.724077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:39.724519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:39.725323 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:39.725854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:39.851065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:39.859421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:39.860915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:39.862056 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3a10a4f6-a48d-4ca8-9328-5bcb80e945b7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.149149 Jul 27 08:43:39.862649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 227/467] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:39 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:40.713847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:40.714476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:40.721153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:40.721591 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:40.722384 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:40.722809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:40.864787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:40.872643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c2af1a7b-fad6-4c3e-b98d-d765928a1b98 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.163347 Jul 27 08:43:40.873209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 241/468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:40 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:40.884738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:40.885365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:40.891747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:40.892195 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:40.892953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:40.893384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:41.022670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:41.031055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:41.032575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:41.033723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-64fdacfb-e401-485b-bf96-eeef1f28e8fe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.152933 Jul 27 08:43:41.034293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 228/469] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:40 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:41.892741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:41.893344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:41.899784 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:41.904306 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:41.904306 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:41.904306 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:42.040268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:42.048132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-223881eb-1426-481f-9cd4-000d227f4792 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.159219 Jul 27 08:43:42.048726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 242/470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:41 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:42.056829 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:42.057434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:42.064041 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:42.064492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:42.065248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:42.065700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:42.068176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:43:42.197261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:42.205648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:42.207181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:42.208340 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f2ad74d6-cfd1-4443-9154-b0f29873b1ac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.155510 Jul 27 08:43:42.209155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 229/471] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:42 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:43.069474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:43.070073 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:43.076498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:43.076939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:43.077693 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:43.078123 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:43.218645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-b3b15d35-4813-4b3a-b759-7500447caf28 req-a3571354-7d0c-49a4-865f-d7a8b33b9820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "name": "network-vif-plugged", "status": "completed", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:43:43.221729 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:43.230503 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-b3b15d35-4813-4b3a-b759-7500447caf28 req-a3571354-7d0c-49a4-865f-d7a8b33b9820 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:43.230950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-b3b15d35-4813-4b3a-b759-7500447caf28 req-a3571354-7d0c-49a4-865f-d7a8b33b9820 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:43.231546 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-83698076-5559-4bd8-9e01-4deba9cf3c13 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.166548 Jul 27 08:43:43.232154 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 243/472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:43 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:43:43.236779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:43.237384 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:43.243973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:43.244424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:43.245217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:43.245659 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:43.248944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-b3b15d35-4813-4b3a-b759-7500447caf28 req-a3571354-7d0c-49a4-865f-d7a8b33b9820 service nova] Creating event network-vif-plugged:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:43:43.254197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-b3b15d35-4813-4b3a-b759-7500447caf28 req-a3571354-7d0c-49a4-865f-d7a8b33b9820 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039411 Jul 27 08:43:43.254739 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 230/473] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:43:43.378291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:43.387146 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:43.388653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:43.389820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ff23ba18-da25-4f8a-9107-ed9b6b8c7b91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.156724 Jul 27 08:43:43.390402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 244/474] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:43 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:43:44.254224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:44.254952 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:44.261688 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:44.262134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:44.262925 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:44.263347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:44.405341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:44.412258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:44.413042 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:44.413742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7d7955a4-3d7e-487d-a315-3e0f719912df tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.164257 Jul 27 08:43:44.414349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 231/475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:44 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:44.419357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:44.419806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:44.420592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:44.421029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:44.552210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:44.560035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:44.561538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:44.562721 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6c114fee-9e58-4b03-822d-91ad5e7b90a8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.154267 Jul 27 08:43:44.563273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 245/476] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:44 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:45.434333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:45.434924 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:45.441363 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:45.444361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:45.444361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:45.444361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:45.586833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:45.587321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:45.587951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:45.594646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:45.594872 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-90c96f3c-db0c-4010-b36a-d2aac8bb72b6 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1755 microversion: 2.1 time: 0.164408 Jul 27 08:43:45.595089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:45.595434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 232/477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:45 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:45.595857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:45.596371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:45.723041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:45.731558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:45.733070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:45.734219 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e881a1b0-2fb4-4aa2-b10d-697fd67cd9b3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.151654 Jul 27 08:43:45.734778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 246/478] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:45 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:46.616141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:46.616755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:46.623342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:46.623789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:46.624537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:46.624966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:46.757098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:46.757823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:46.764393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:46.764918 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:46.765847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:46.766510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:46.772327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:46.780894 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-53d5e6a0-926e-4b00-aa3c-0e1e3efad0fc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1758 microversion: 2.1 time: 0.168679 Jul 27 08:43:46.788887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 233/479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:43:46 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:43:46.907992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:46.917143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:46.918749 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:46.919923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1572abfc-8a05-483d-8bbb-d6d74bd6f747 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1810 microversion: 2.20 time: 0.166917 Jul 27 08:43:46.920482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 247/480] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:46 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:43:47.941993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:43:47.942626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:43:47.949421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:47.949871 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:47.953197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:43:47.953197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:43:48.077372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:48.086797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:48.088370 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:43:48.089525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-19bc5e21-a59e-4a0a-bde9-2471b6d2741e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1797 microversion: 2.20 time: 0.151504 Jul 27 08:43:48.090091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 234/481] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:43:47 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1797 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:44:26.919625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:26.920202 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:26.922223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=25 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:26.922866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=62 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:26.927609 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:26.928058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:26.928815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:26.929248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:27.156231 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lazy-loading 'services' on Instance uuid f7739cba-0102-4d24-ac1e-904912fe2c65 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:27.417950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2c9b94b1-30bf-4f70-8a66-ae9b4d1a195a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments/59f1fe16-3a91-4fef-b28a-f379342cf43f" status: 202 len: 0 microversion: 2.1 time: 0.502774 Jul 27 08:44:27.418764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 248/482] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:44:26 2022] DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments/59f1fe16-3a91-4fef-b28a-f379342cf43f => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:29.592271 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6fee94e8-19b7-4c14-9f6c-6d37716cbc75 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:29.594550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=23 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:29.595358 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=31 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:29.599974 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fee94e8-19b7-4c14-9f6c-6d37716cbc75 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:29.600420 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fee94e8-19b7-4c14-9f6c-6d37716cbc75 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:29.621826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6fee94e8-19b7-4c14-9f6c-6d37716cbc75 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Going to try to stop instance {{(pid=129924) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 08:44:29.755335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6fee94e8-19b7-4c14-9f6c-6d37716cbc75 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action" status: 202 len: 0 microversion: 2.1 time: 0.167594 Jul 27 08:44:29.756010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 235/483] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:44:29 2022] POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:29.766288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:29.767247 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:29.774933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:29.775381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:29.776143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:29.776587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:29.910287 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:29.917703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0b78902c-19fd-4161-b96c-3463959b27da tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.156709 Jul 27 08:44:29.918792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 249/484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:29 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:30.941003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:30.941710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:30.948453 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:30.948900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:30.949692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:30.950166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:31.130465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:31.138371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a8f85458-e17c-4ef6-ba0a-eb2b7be092b3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.201811 Jul 27 08:44:31.138927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 236/485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:30 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:32.261167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:32.261774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:32.267674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:32.268119 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:32.268873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:32.269305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:32.394643 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:32.401946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5c51461a-e5f7-41a3-8a48-df0e65295f03 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.245816 Jul 27 08:44:32.402550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 250/486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:32 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:33.425245 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:33.425856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:33.432431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:33.432877 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:33.433636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:33.434071 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:33.557632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:33.565737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e7057389-800d-4a3a-8970-c17c12d02515 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.144365 Jul 27 08:44:33.566321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 237/487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:33 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:34.587612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:34.588223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:34.594771 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:34.595212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:34.595958 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:34.596380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:34.726183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:34.733549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-77a778f5-3a82-410f-9a9f-d3d2fd588ee7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.150505 Jul 27 08:44:34.734099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 251/488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:34 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:35.754985 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:35.757362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:35.762111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:35.762580 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:35.763397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:35.763958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:35.889306 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:35.896671 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7cab9e60-ae63-4385-8806-1b381e366af2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.145476 Jul 27 08:44:35.897227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 238/489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:35 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:36.730472 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21badbd2-32bb-4f61-84b8-6ec0b9ccc281"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:36.733056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:36.739497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:36.739934 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:36.740689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:36.741117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:36.918506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:36.919117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:36.925674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:36.926127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:36.926923 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:36.927356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:37.063135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:37.070057 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-89642edb-40ec-472e-9251-b3045d98f396 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.155460 Jul 27 08:44:37.070665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 239/490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:36 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:44:37.458988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-25ae6dbc-600f-4fc4-82fa-0807f23558b1 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732295 Jul 27 08:44:37.459602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 252/491] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:44:36 2022] POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:38.090866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:38.096939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:38.098649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:38.099097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:38.099860 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:38.100295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:38.226115 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:38.234183 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9aef20bd-d525-4d02-9565-b2dbe5708a5b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.147212 Jul 27 08:44:38.234749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 240/492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:38 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:38.333673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:44:38.333871 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 08:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:44:39.256228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:39.256923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:39.263033 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:39.264117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:39.265053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:39.265486 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:39.393438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:39.400761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e653d881-c951-4cfa-988e-75e35a097294 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1675 microversion: 2.1 time: 0.149215 Jul 27 08:44:39.401317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 253/493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:39 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:44:40.421818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:40.422715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:40.429039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:40.429486 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:40.430275 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:40.430709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:40.563689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:40.575695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3551563d-c474-4091-a3c9-e28359e7dd86 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1652 microversion: 2.1 time: 0.153398 Jul 27 08:44:40.575695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 241/494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:40 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:40.593092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-19b15766-90b7-466a-b80b-598e39ee08e4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:40.599637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-19b15766-90b7-466a-b80b-598e39ee08e4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:40.600078 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-19b15766-90b7-466a-b80b-598e39ee08e4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:40.621441 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-19b15766-90b7-466a-b80b-598e39ee08e4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Going to try to start instance {{(pid=129921) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 08:44:40.787073 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-19b15766-90b7-466a-b80b-598e39ee08e4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action" status: 202 len: 0 microversion: 2.1 time: 0.197961 Jul 27 08:44:40.787714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 254/495] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:44:40 2022] POST /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:40.796506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:40.797116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:40.803177 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:40.803631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:40.804400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:40.804867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:40.935210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:40.944287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-97a169ad-ac13-4fe9-b1f8-a96f477cdf50 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1661 microversion: 2.1 time: 0.152114 Jul 27 08:44:40.944848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 242/496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:40 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:41.967552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:41.968225 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:41.974450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:41.974891 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:41.975645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:41.976072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:42.104413 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:42.112016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2fd880b6-c1c7-4ea1-8101-adf962274f44 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1661 microversion: 2.1 time: 0.150247 Jul 27 08:44:42.112574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 255/497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:41 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:43.132722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:43.133324 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:43.139775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:43.140243 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:43.140993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:43.141418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:43.268480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:43.275912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-53f9e2ab-f595-41a9-b20c-22ee53405924 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1665 microversion: 2.1 time: 0.146951 Jul 27 08:44:43.276480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 243/498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:43 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1665 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:46.036360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:46.038606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:46.045134 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:46.045580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:46.046399 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:46.046834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:46.068933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lazy-loading 'flavor' on Instance uuid 8f053d88-ea01-4efa-9bcc-0880e6194203 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:46.425994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b1119e56-01b2-4492-90d3-22c367d3d4ae tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/action" status: 200 len: 32 microversion: 2.1 time: 0.393445 Jul 27 08:44:46.426690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 256/499] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:44:46 2022] POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/action => generated 32 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:44:46.436664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:46.437269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:46.443850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:46.444303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:46.445121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:46.445558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:46.609465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:46.617310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e2350166-a6ed-401f-9be7-5378c344ca89 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.185123 Jul 27 08:44:46.617870 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 244/500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:46 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:47.308493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:47.309159 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:47.315964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.316413 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.317186 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.317617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.342223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a6c0b987-39cd-4ca5-a595-ca8f41cfa417 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/ips" status: 200 len: 150 microversion: 2.1 time: 0.089264 Jul 27 08:44:47.342763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 257/501] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:44:47 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:47.353942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4818ec6c-8f1a-4580-a391-ca414406e3ba"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:47.356339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:47.362595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.363039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.363797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.364223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.442635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: POST /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/os-volume_attachments HTTP/1.1 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 74 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:44:47.444347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {"volumeAttachment": {"volumeId": "4818ec6c-8f1a-4580-a391-ca414406e3ba"}} Jul 27 08:44:47.445918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'server_id': '80c4e570-1a1e-48ce-a477-0c84bcec9fbc', 'body': {'volumeAttachment': {'volumeId': '4818ec6c-8f1a-4580-a391-ca414406e3ba'}}} Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:44:47.446873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:47.448824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 400 to user: Invalid volume: volume 4818ec6c-8f1a-4580-a391-ca414406e3ba is already attached to instances: ba1df927-86a0-4ed5-aad6-b45dd817b46e {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ea62a82f-8a93-47bf-a63a-393756d45722 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095801 Jul 27 08:44:47.450348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 245/502] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:44:47 2022] POST /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:44:47.455216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:47.455702 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:47.461792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.462276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.463024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.463450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.487143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:44:47.521653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:47.638574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:47.639184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:47.645917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.646399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.647262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.647712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.780690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:47.788824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-cdae771f-9a67-47e0-8977-ad4fa65bffc9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.154302 Jul 27 08:44:47.789384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 246/503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:47 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:44:47.836275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a8de41ef-3e2c-43d0-bc68-89bf32746d18 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 204 len: 0 microversion: 2.1 time: 0.384833 Jul 27 08:44:47.836882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 258/504] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:44:47 2022] DELETE /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 08:44:47.845399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:47.847493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:47.852049 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.852504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.853272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:47.853707 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:47.983765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:47.991281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8c2631f1-1e54-4ea1-8c09-e1b205170679 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1682 microversion: 2.1 time: 0.150126 Jul 27 08:44:47.991873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 247/505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:47 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:48.812253 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:48.812970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:48.821044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:48.821044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:48.821044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:48.821473 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:48.948776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:48.957527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4505fb18-19f4-438c-b0aa-a825d10d969f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.150237 Jul 27 08:44:48.958086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 259/506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:48 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:49.011847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:49.012465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:49.019784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:49.020232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:49.023268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:49.023268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:49.147258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:49.154780 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f72fc218-8c72-42d1-aacb-575419e12b54 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1682 microversion: 2.1 time: 0.146705 Jul 27 08:44:49.155339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 248/507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:49 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:49.979080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:49.979693 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:49.986232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:49.986683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:49.987453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:49.987889 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:50.115665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:50.123724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f0165403-98e6-4158-81db-fd2317b0300a tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.148379 Jul 27 08:44:50.124323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 260/508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:49 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:50.176385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:50.177157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:50.183517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:50.183970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:50.184752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:50.185909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:50.471918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:50.479625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-54260ae6-a334-48fe-8d2f-105680d05227 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1682 microversion: 2.1 time: 0.307341 Jul 27 08:44:50.480242 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 249/509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:50 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1682 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:51.008026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-6c48ad65-2c67-49ff-acbe-065096ddc138 req-d7be4bb4-c324-4d87-92e3-12a792ef9e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c4e570-1a1e-48ce-a477-0c84bcec9fbc", "name": "network-vif-deleted", "tag": "3dc911f5-2c16-4531-acf6-43762dc287c7"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:51.020055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-6c48ad65-2c67-49ff-acbe-065096ddc138 req-d7be4bb4-c324-4d87-92e3-12a792ef9e1d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.020832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-6c48ad65-2c67-49ff-acbe-065096ddc138 req-d7be4bb4-c324-4d87-92e3-12a792ef9e1d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.031918 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-6c48ad65-2c67-49ff-acbe-065096ddc138 req-d7be4bb4-c324-4d87-92e3-12a792ef9e1d service nova] Creating event network-vif-deleted:3dc911f5-2c16-4531-acf6-43762dc287c7 for instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc on hv-cinder-85117 Jul 27 08:44:51.036947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-6c48ad65-2c67-49ff-acbe-065096ddc138 req-d7be4bb4-c324-4d87-92e3-12a792ef9e1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Jul 27 08:44:51.037528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 261/510] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:51.145757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:51.146726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:51.153047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.153499 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.154457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.154990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.173570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:51.296841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:51.305318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-95700f99-1f3e-43f7-a30f-1f296e5ffcb6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.163487 Jul 27 08:44:51.306011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 250/511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:51 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:51.502540 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:51.503468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:51.510096 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.510818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.511728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.512308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.545677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:51.546391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:51.546837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'fault' on Instance uuid 80c4e570-1a1e-48ce-a477-0c84bcec9fbc {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:51.595520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:51.608992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9acd9aa0-f9d8-4152-94a0-9fa0e8b95bfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 200 len: 1331 microversion: 2.1 time: 0.110370 Jul 27 08:44:51.610021 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 262/512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:51 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:52.327543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:52.328150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:52.335020 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:52.335468 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:52.336484 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:52.337169 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:52.469711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:52.477737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5ee4f436-d5c1-4b39-8546-4085ec7d8193 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.154558 Jul 27 08:44:52.478334 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 251/513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:52 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:52.630777 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:52.631494 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:52.637940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:52.638469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:52.639231 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:52.639657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:52.655154 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc HTTP/1.1 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:44:52.656746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:44:52.658270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '80c4e570-1a1e-48ce-a477-0c84bcec9fbc'} Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:44:52.659105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:44:52.660248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:44:52.661280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:44:52.661280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-803848eb-c0a2-4d8f-85d7-85b753a0f70f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 404 len: 111 microversion: 2.1 time: 0.031223 Jul 27 08:44:52.661280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 263/514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:52 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:44:52.666919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2a444248-0185-4bd0-8071-3ed7e2150376 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '.version_select at 0x7f78f142f310>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:52.771362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2a444248-0185-4bd0-8071-3ed7e2150376 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208439677" status: 202 len: 0 microversion: 2.1 time: 0.108207 Jul 27 08:44:52.772653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 252/515] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Jul 27 08:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208439677 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:53.500922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:53.501754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:53.509529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.510392 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:53.511829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.512233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:53.596342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:53.596820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:53.605359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.605802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:53.606596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.607088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:53.650803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:53.659431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7bf5dd68-c875-4554-8c8f-20bad280cb04 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.163139 Jul 27 08:44:53.659995 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 264/516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:53 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:44:53.730790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'services' on Instance uuid ba1df927-86a0-4ed5-aad6-b45dd817b46e {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:53.964374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1d25ed1a-4602-4d73-bbb6-adc73166ae8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments/4818ec6c-8f1a-4580-a391-ca414406e3ba" status: 202 len: 0 microversion: 2.1 time: 0.372311 Jul 27 08:44:53.964972 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 253/517] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:44:53 2022] DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments/4818ec6c-8f1a-4580-a391-ca414406e3ba => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:44:53.974762 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:53.976950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:53.983677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.984363 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:53.985235 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:53.985664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.014560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9c999f12-96d0-492b-aac8-6cab948c5be8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Jul 27 08:44:54.019362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 265/518] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:53 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:54.041244 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1089187466"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:54.041867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:54.049376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:54.049825 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.050625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:54.051058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.183912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.network.security_group_api [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Removing security group ffe5ad9a-0397-4d7e-84ae-e9c69a18d94d from port 7246bf69-568f-45e6-aaee-ec190910b2b8 Jul 27 08:44:54.575111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-66811c73-b536-4806-86f8-f7653dfd1744 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.538106 Jul 27 08:44:54.576821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 254/519] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:44:54 2022] POST /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:54.682984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:54.684361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:54.684878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-eea2fc43-9fba-45a3-8769-ef9d45deb117 req-ba09b128-56ec-40e0-996f-e182c481503d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:54.692403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:54.692859 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.693673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:54.694455 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.698557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-eea2fc43-9fba-45a3-8769-ef9d45deb117 req-ba09b128-56ec-40e0-996f-e182c481503d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:54.699215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-eea2fc43-9fba-45a3-8769-ef9d45deb117 req-ba09b128-56ec-40e0-996f-e182c481503d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:54.713536 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-eea2fc43-9fba-45a3-8769-ef9d45deb117 req-ba09b128-56ec-40e0-996f-e182c481503d service nova] Creating event network-changed:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:44:54.719055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-eea2fc43-9fba-45a3-8769-ef9d45deb117 req-ba09b128-56ec-40e0-996f-e182c481503d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136909 Jul 27 08:44:54.720050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 266/520] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:54.861230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:54.870977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b11b0dc6-f6bf-4fa8-85be-d990d56fc086 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.192527 Jul 27 08:44:54.871555 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 255/521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:54 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:55.028570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:55.034636 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:55.037983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.038799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.039734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.040304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.081973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e0e4df00-e688-4032-90bd-19d32207124a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058362 Jul 27 08:44:55.082571 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 267/522] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:55 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:55.501354 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:55.501843 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:55.507968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.508412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.509165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.509594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.538344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3c0b4439-cc82-4cc3-8969-1dca30213b6b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments/50166dc3-1157-4128-88e5-34b5dc4c213b" status: 200 len: 194 microversion: 2.20 time: 0.156083 Jul 27 08:44:55.538909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 256/523] 10.222.0.40 () {60 vars in 1454 bytes} [Wed Jul 27 08:44:55 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments/50166dc3-1157-4128-88e5-34b5dc4c213b => generated 194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:44:55.610846 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:55.611338 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:55.617444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.617892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.618741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.619175 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.703297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lazy-loading 'services' on Instance uuid 73303fae-c87c-4ca8-86ef-f53a66bb47d9 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:55.894539 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:55.895120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:55.901480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.901928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.902722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.903157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.944229 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5dbbf809-d53a-459e-9dcd-712cb9766765 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments/50166dc3-1157-4128-88e5-34b5dc4c213b" status: 202 len: 0 microversion: 2.20 time: 0.337364 Jul 27 08:44:55.945180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 268/524] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Jul 27 08:44:55 2022] DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments/50166dc3-1157-4128-88e5-34b5dc4c213b => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:44:55.956329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:55.959050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:55.966022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.966513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.968386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:55.968850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:55.999674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b7910ed9-b763-4c2f-a5b5-d80a91d3f854 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048295 Jul 27 08:44:56.000500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 269/525] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:44:55 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:44:56.054342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:56.069440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-36717727-2a3b-4dd6-9a01-67ee0107a60e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.178291 Jul 27 08:44:56.070521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 257/526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:55 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:56.088305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:56.088824 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:56.099742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.100086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.100864 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.101301 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.188594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-676d4763-3012-41ba-ab8f-d7ddb7286d6f req-afe6413e-4078-4dbb-8c70-78682b705589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:44:56.198834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lazy-loading 'services' on Instance uuid 37c42449-37d4-48b2-baa1-77af8f327d8c {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:44:56.204375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-676d4763-3012-41ba-ab8f-d7ddb7286d6f req-afe6413e-4078-4dbb-8c70-78682b705589 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.205080 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-676d4763-3012-41ba-ab8f-d7ddb7286d6f req-afe6413e-4078-4dbb-8c70-78682b705589 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.222380 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-676d4763-3012-41ba-ab8f-d7ddb7286d6f req-afe6413e-4078-4dbb-8c70-78682b705589 service nova] Creating event network-changed:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:44:56.227959 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-676d4763-3012-41ba-ab8f-d7ddb7286d6f req-afe6413e-4078-4dbb-8c70-78682b705589 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142305 Jul 27 08:44:56.228584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 258/527] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:56.234456 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:56.236754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:56.243744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.244194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.244960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.245392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.275194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-93f779ab-fdea-4f9e-993c-3d5a7c92d845 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045377 Jul 27 08:44:56.275793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 259/528] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:56 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:44:56.343360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:56.343933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:56.349999 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.350525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.351375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.351815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.376908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:44:56.426247 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bed854e8-c905-45fc-a0b9-e88f021cc1c0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments/5eb6ccb9-40c0-4036-aac2-797101494d81" status: 202 len: 0 microversion: 2.1 time: 0.341882 Jul 27 08:44:56.426831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 270/529] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:44:56 2022] DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments/5eb6ccb9-40c0-4036-aac2-797101494d81 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:44:56.435303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:56.438182 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:56.444276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.444718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.445470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.445894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.476158 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-421d9cc5-596e-4fee-8f61-f3c7f74e224f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Jul 27 08:44:56.476722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 271/530] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:56 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:44:56.644264 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1b53698c-3522-469a-9cea-83d999d97636 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 204 len: 0 microversion: 2.1 time: 0.304457 Jul 27 08:44:56.644777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 260/531] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:44:56 2022] DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 08:44:56.653147 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:56.657384 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:56.662002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.663018 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.664656 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:56.665171 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:56.830224 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:56.844349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1a49fb3b-93e2-40a8-ba3b-ce74dbed626a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1684 microversion: 2.1 time: 0.195221 Jul 27 08:44:56.844975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 272/532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:56 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:57.013485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:57.016422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:57.023115 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.023654 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.024461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.024906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.056971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0149cea8-243b-40ef-8d79-67091ee47745 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048091 Jul 27 08:44:57.057535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 261/533] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:44:57 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:44:57.105273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:57.105878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:57.108051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:57.113417 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.113942 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.114741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.121149 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.246969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:57.254787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6694efce-60b3-4e0c-ba5f-904599cb2a49 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.153345 Jul 27 08:44:57.255346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 273/534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:57 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:57.488835 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:57.490940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:57.496936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.497389 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.498219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.498664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.526752 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-779f8a16-27a8-4187-b503-d5cdc690d656 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Jul 27 08:44:57.527301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 262/535] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:57 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:57.865820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:57.866484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:57.873482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.873923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.874701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:57.875129 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:57.999770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:58.007058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e98dfcd6-b481-458d-9085-7df11934f8b5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1684 microversion: 2.1 time: 0.144975 Jul 27 08:44:58.007610 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 274/536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:57 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1684 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:58.068917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:58.071042 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:58.077530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.077971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.078757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.079189 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.107991 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2cc7eee1-c330-4b58-872c-0dee1f51ff5d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042542 Jul 27 08:44:58.108532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 263/537] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:44:58 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:44:58.276544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:58.277099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:58.283164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.283601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.284344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.284770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.288677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:58.421812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:58.429764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a5c47b39-fe8a-4b8f-9b0d-5ad0d99cbe65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.157115 Jul 27 08:44:58.430396 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 275/538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:58 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:58.539947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:58.542039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:58.548997 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.549443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.550229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:58.550664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:58.580282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7d0420ae-c774-4990-9c6d-59ad1cf1092f tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Jul 27 08:44:58.580863 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 264/539] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:58 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:44:59.028723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:59.029545 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:59.036010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.036455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.037207 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.037638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.120636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:59.122694 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:59.129293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.129736 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.130525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.130954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.160086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-36eaf5bf-f318-4e7e-8349-9128a0f034e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043536 Jul 27 08:44:59.160650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 265/540] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:44:59 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 08:44:59.172603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:59.180000 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ea6e820c-2acf-4df1-90b9-83865b644aa3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1684 microversion: 2.1 time: 0.155164 Jul 27 08:44:59.180558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 276/541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:59 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:44:59.451487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:59.452264 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:59.458759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.459207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.459966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.460399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.593482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:44:59.595880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:44:59.602223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.602675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.603439 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:44:59.603871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:44:59.633222 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c9dbbcca-3abe-48f6-a111-a782fed8ef9a tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Jul 27 08:44:59.633994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 277/542] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:44:59 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:44:59.635580 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:44:59.640531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:44:59.647245 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-def7aa71-6e27-4528-adec-7fb9b4da7e65 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.199037 Jul 27 08:44:59.647836 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 266/543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:44:59 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:00.173990 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.176275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.182768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.183187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.183942 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.184371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.201853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.203365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.205682 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:00.210850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.211840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.212886 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.213447 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.215496 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-356c3bc1-5efc-454b-8059-cc7097242ae3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046402 Jul 27 08:45:00.222270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 278/544] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:45:00 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:00.301778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.302369 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.309242 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.309690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.311178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.311702 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.340205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:45:00.524544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:00.532231 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7fe0a358-85e1-487a-b60a-c6c1ab4cd0ec tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1616 microversion: 2.1 time: 0.335216 Jul 27 08:45:00.532803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 267/545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:00 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1616 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:00.648689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.657488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.659166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.659746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.660686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.661232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.681030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bde2be35-05e6-4261-a2be-c6ab4f6dbf4c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 204 len: 0 microversion: 2.20 time: 0.383364 Jul 27 08:45:00.688746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 279/546] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Jul 27 08:45:00 2022] DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 08:45:00.696129 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.696333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f217e120-6417-40dc-872a-78f2c8f6c671 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052979 Jul 27 08:45:00.697114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.697505 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 268/547] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:45:00 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:45:00.703257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.703873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.710558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.711098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.712180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.712779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.717343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.717943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.719031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.719248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.862740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:00.871714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-aca5168d-d52e-4bb6-adb2-bb4a26634613 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.181508 Jul 27 08:45:00.872657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 280/548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:00 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:00.889533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:00.890165 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:00.895971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:00.896683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.897129 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.898051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.898527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.904615 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:00.906116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:00.907321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b1fca678-84e0-482a-a66f-0a51ac841e82 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.208664 Jul 27 08:45:00.907880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 269/549] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:00 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:00.913007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-04c6237a-a91a-4743-8d43-444f97aa2eaf req-b9e591e5-82fc-413b-80ef-ad24f771884a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1df927-86a0-4ed5-aad6-b45dd817b46e", "name": "network-vif-deleted", "tag": "55ebce99-8df7-4923-ac6f-3bba997bb3ff"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:00.923376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-04c6237a-a91a-4743-8d43-444f97aa2eaf req-b9e591e5-82fc-413b-80ef-ad24f771884a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:00.924155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-04c6237a-a91a-4743-8d43-444f97aa2eaf req-b9e591e5-82fc-413b-80ef-ad24f771884a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:00.939641 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-04c6237a-a91a-4743-8d43-444f97aa2eaf req-b9e591e5-82fc-413b-80ef-ad24f771884a service nova] Creating event network-vif-deleted:55ebce99-8df7-4923-ac6f-3bba997bb3ff for instance ba1df927-86a0-4ed5-aad6-b45dd817b46e on hv-cinder-85117 Jul 27 08:45:00.944942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-04c6237a-a91a-4743-8d43-444f97aa2eaf req-b9e591e5-82fc-413b-80ef-ad24f771884a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Jul 27 08:45:00.945655 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 270/550] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:00.980399 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] HTTP exception thrown: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c is not attached to volume 5eb6ccb9-40c0-4036-aac2-797101494d81 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Request method failure captured: Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments/5eb6ccb9-40c0-4036-aac2-797101494d81 HTTP/1.1 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PoemRgWwYq6OJ1thDSHb7nQVNOZ7yYtLlZ0KtnN8TGkgfrLb1kll7myLyfr9G0InUcOMWIRJS2i09jRieRVAW4ssYr00_YO_DoIw3uLNXeo64RsC6vT-AljID1HGt7oqlBrwkWxupeLRvEsaySEDWi6b6Fn2mdhVrckWnwJuBpLZHM Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 52bd08da2d1746c6a84cf75143ae6bf6 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:45:00.983367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52bd08da2d1746c6a84cf75143ae6bf6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 52bd08da2d1746c6a84cf75143ae6bf6 Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-TestMinimumBasicScenario-1038242888-project Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 789e8d5e223a42379153011a7b986d50 Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-TestMinimumBasicScenario-1038242888-project Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:45:00.985011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c is not attached to volume 5eb6ccb9-40c0-4036-aac2-797101494d81 Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'server_id': '37c42449-37d4-48b2-baa1-77af8f327d8c', 'id': '5eb6ccb9-40c0-4036-aac2-797101494d81'} Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5eb6ccb9-40c0-4036-aac2-797101494d81. Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:00.985862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c is not attached to volume 5eb6ccb9-40c0-4036-aac2-797101494d81 Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c is not attached to volume 5eb6ccb9-40c0-4036-aac2-797101494d81 Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:00.987296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Returning 404 to user: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c is not attached to volume 5eb6ccb9-40c0-4036-aac2-797101494d81 {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:00.989351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-51e28299-43c4-4643-a22f-9843d3f3bea0 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments/5eb6ccb9-40c0-4036-aac2-797101494d81" status: 404 len: 154 microversion: 2.1 time: 0.101312 Jul 27 08:45:00.989351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 281/551] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:45:00 2022] DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c/os-volume_attachments/5eb6ccb9-40c0-4036-aac2-797101494d81 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:01.555448 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:01.565715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:01.565715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.565715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:01.565715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.566121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:01.628745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:01.636465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0ce7d48d-a7fe-41a7-ab80-acc47c4a4db9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1616 microversion: 2.1 time: 0.085231 Jul 27 08:45:01.637031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 271/552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:01 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1616 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:01.894010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:01.894642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:01.901191 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.905500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:01.905500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.905500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:01.930565 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:01.931173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:01.937975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.938460 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:01.939229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:01.939666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.045281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.066012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0ccc092c-2677-4908-944d-fc33ae291c13 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.163275 Jul 27 08:45:02.066012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 282/553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:01 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:02.081655 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.089837 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.091366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.093332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-bd3e0dee-9abf-4a00-acfd-7aeec9d5ce53 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.166778 Jul 27 08:45:02.093894 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 272/554] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:01 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:45:02.250280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:02.250775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:02.257518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.257962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.258743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.259176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.284094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:45:02.550094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-debf292a-e54d-438f-acf2-950a18fa6992 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 204 len: 0 microversion: 2.1 time: 0.304085 Jul 27 08:45:02.550738 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 283/555] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:45:02 2022] DELETE /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:45:02.564589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:02.565200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:02.571384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.571834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.572601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.573062 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.657597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:02.658330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:02.664513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.664960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.665751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.666193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.699077 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:02.699801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:02.700318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'fault' on Instance uuid ba1df927-86a0-4ed5-aad6-b45dd817b46e {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:45:02.702104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.709595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8d4210d2-679c-4a25-95a2-cd3b1b2ba5dc tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1552 microversion: 2.1 time: 0.149571 Jul 27 08:45:02.710363 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 273/556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:02 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:02.740971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:02.748910 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-41e1d58b-a179-4cd3-95e2-5306b4d445b7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1332 microversion: 2.1 time: 0.095799 Jul 27 08:45:02.749463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 284/557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:02 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:03.075188 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:03.075786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:03.082404 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.082848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.083601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.084029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.115577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:03.116195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:03.122671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.123270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.124035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.124466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.215080 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.223791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-011f40a1-6a80-4de5-9331-82872c9a9b5f tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.152485 Jul 27 08:45:03.224440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 274/558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:03 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:03.256602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.265451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.267004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.268235 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4f9d6d5f-1423-4425-9d1c-215805f728b6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.156510 Jul 27 08:45:03.268791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 285/559] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:03 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:45:03.730771 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:03.731310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:03.737395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.737833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.738606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.739034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.771364 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:03.772087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:03.778325 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.778914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.779736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.780179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.811376 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:03.811819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:03.812259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'fault' on Instance uuid ba1df927-86a0-4ed5-aad6-b45dd817b46e {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:45:03.853467 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.861018 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9e64d1c9-2ad9-4d47-add1-db8844abbf04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1332 microversion: 2.1 time: 0.093819 Jul 27 08:45:03.861574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 286/560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:03 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:03.867846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:03.875967 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b1d29f14-0594-4560-9d8c-7c02d8a77326 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1552 microversion: 2.1 time: 0.149058 Jul 27 08:45:03.876526 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 275/561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:03 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:04.245741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:04.246379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:04.253029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.253477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.254270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.254706 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.293498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:04.294375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:04.300964 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.301420 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.302210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.302675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.387931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:04.392054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:04.397090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-38d17e9f-3641-4fce-b4fc-181f30c38e3e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.155215 Jul 27 08:45:04.397661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 287/562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:04 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:04.467153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:04.475019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:04.476521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:04.477662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-060b7aa0-baf7-48b6-bfd2-c54e48276a6e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.188892 Jul 27 08:45:04.478231 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 276/563] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:04 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:04.882391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:04.883112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:04.889733 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.891737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.891737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.891737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.897717 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:04.898568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:04.906294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.907390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.908184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.908633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.924698 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:04.925148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:04.925981 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'fault' on Instance uuid ba1df927-86a0-4ed5-aad6-b45dd817b46e {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:45:04.971122 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:04.978475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-75228e47-8107-4b08-a194-3a048ae29264 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 200 len: 1332 microversion: 2.1 time: 0.099855 Jul 27 08:45:04.979082 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 288/564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:04 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:05.283862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:05.292732 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5f3d45f0-787d-4a8c-9516-91cb9de5fff2 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1552 microversion: 2.1 time: 0.399173 Jul 27 08:45:05.293737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 277/565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:04 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1552 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:05.419052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:05.420024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:05.428164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:05.428617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:05.429390 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:05.430115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:05.506955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:05.507588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:05.525714 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:05.526528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:05.527572 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:05.528010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:05.613740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:05.624114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b14721a7-ea7c-41ca-8f88-de51ed1cb7c4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.208905 Jul 27 08:45:05.624703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 289/566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:05 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:05.830130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:05.862080 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:05.863611 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:05.864757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-dc86cde8-b04b-43c2-9a82-955a5162be4b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1725 microversion: 2.20 time: 0.368313 Jul 27 08:45:05.865308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 278/567] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:05 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:06.001985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:06.003524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:06.011936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.012813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.014877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.015514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.024895 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-44c08265-5100-4f31-8cab-8ce4b24ad0f3 req-c08e120a-be97-4b48-bcee-c7eba6d62442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c42449-37d4-48b2-baa1-77af8f327d8c", "name": "network-vif-deleted", "tag": "7246bf69-568f-45e6-aaee-ec190910b2b8"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:06.033984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e HTTP/1.1 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:45:06.036946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:45:06.038259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'ba1df927-86a0-4ed5-aad6-b45dd817b46e'} Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:06.038992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:45:06.040890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:06.043488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-44c08265-5100-4f31-8cab-8ce4b24ad0f3 req-c08e120a-be97-4b48-bcee-c7eba6d62442 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.043488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-44c08265-5100-4f31-8cab-8ce4b24ad0f3 req-c08e120a-be97-4b48-bcee-c7eba6d62442 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.045579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:06.047010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9eec0ca9-d7e8-45ae-aca7-de4f2f3e75d0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 404 len: 111 microversion: 2.1 time: 0.051175 Jul 27 08:45:06.048079 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 290/568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:05 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:06.055701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-44c08265-5100-4f31-8cab-8ce4b24ad0f3 req-c08e120a-be97-4b48-bcee-c7eba6d62442 service nova] Creating event network-vif-deleted:7246bf69-568f-45e6-aaee-ec190910b2b8 for instance 37c42449-37d4-48b2-baa1-77af8f327d8c on hv-cinder-85117 Jul 27 08:45:06.058558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7230603e-8ebc-4ddd-a37f-e58392f72ca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '.version_select at 0x7f78f0be2d30>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:06.061593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-44c08265-5100-4f31-8cab-8ce4b24ad0f3 req-c08e120a-be97-4b48-bcee-c7eba6d62442 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041018 Jul 27 08:45:06.062857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 279/569] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:45:06.179333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7230603e-8ebc-4ddd-a37f-e58392f72ca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988688965" status: 202 len: 0 microversion: 2.1 time: 0.126676 Jul 27 08:45:06.180192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 291/570] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Jul 27 08:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988688965 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:45:06.313559 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:06.314490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:06.327891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.328541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.329519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.332916 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.433905 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789e8d5e223a42379153011a7b986d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bd08da2d1746c6a84cf75143ae6bf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:06.443149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6bac360c-3f51-4c1d-83a8-7e3220459502 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 200 len: 1343 microversion: 2.1 time: 0.133810 Jul 27 08:45:06.443963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 280/571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:06 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 1343 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:06.645933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:06.647178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:06.655951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.656635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.657584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.658011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.814422 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:06.823914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-017b0d47-ad62-4b81-a578-bca07277f836 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.182589 Jul 27 08:45:06.834664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 292/572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:06 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:06.888773 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:06.889544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:06.896007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.896457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.897483 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.898163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.930957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:06.931519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:06.932045 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lazy-loading 'fault' on Instance uuid 73303fae-c87c-4ca8-86ef-f53a66bb47d9 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:45:06.980659 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:06.994025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:06.996235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:07.013147 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-308a9b3d-205c-4f40-9ef4-d3d01a8099e3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 200 len: 1372 microversion: 2.20 time: 0.113436 Jul 27 08:45:07.013147 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 281/573] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:06 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:07.191115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c8e7bec9-97fd-4a41-8efb-d4dc9ba7cb51 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: .version_select at 0x7f78f0cc9160>, body: {"keypair": {"name": "tempest-keypair-927699050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwdX28VAvAMnUoJ22NkWlgAvSfjccAeyPOGpz6BsYvFxVDncUIyoeciA6lSKfknkZFmlRoCxnwlB/R807wwEViNfrBPOs1x9QlZ0dO09q26rhMjGmqp2+siKwMC1cC7Bg=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:07.214201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-c8e7bec9-97fd-4a41-8efb-d4dc9ba7cb51 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:07.218966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-c8e7bec9-97fd-4a41-8efb-d4dc9ba7cb51 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:07.312248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c8e7bec9-97fd-4a41-8efb-d4dc9ba7cb51 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124999 Jul 27 08:45:07.313171 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 293/574] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:45:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:07.465268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:07.466004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] [instance: 37c42449-37d4-48b2-baa1-77af8f327d8c] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:07.478095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:07.483506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:07.483506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:07.483506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:07.497242 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] HTTP exception thrown: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Request method failure captured: Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c HTTP/1.1 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PoemRgWwYq6OJ1thDSHb7nQVNOZ7yYtLlZ0KtnN8TGkgfrLb1kll7myLyfr9G0InUcOMWIRJS2i09jRieRVAW4ssYr00_YO_DoIw3uLNXeo64RsC6vT-AljID1HGt7oqlBrwkWxupeLRvEsaySEDWi6b6Fn2mdhVrckWnwJuBpLZHM Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 52bd08da2d1746c6a84cf75143ae6bf6 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:45:07.499706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52bd08da2d1746c6a84cf75143ae6bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52bd08da2d1746c6a84cf75143ae6bf6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 52bd08da2d1746c6a84cf75143ae6bf6 Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1038242888 Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-TestMinimumBasicScenario-1038242888-project Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 789e8d5e223a42379153011a7b986d50 Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-TestMinimumBasicScenario-1038242888-project Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. Jul 27 08:45:07.501008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '37c42449-37d4-48b2-baa1-77af8f327d8c'} Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:07.502550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. Jul 27 08:45:07.503693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:07.504840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Returning 404 to user: Instance 37c42449-37d4-48b2-baa1-77af8f327d8c could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:07.504840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c1e6fa72-c77a-4807-b541-e1e4ab560869 tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c" status: 404 len: 111 microversion: 2.1 time: 0.040160 Jul 27 08:45:07.504840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 282/575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:07 2022] GET /compute/v2.1/servers/37c42449-37d4-48b2-baa1-77af8f327d8c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:07.511071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-826da478-0fbd-4e29-97a3-5e3d8c0c69bb tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] Calling method '.version_select at 0x7f78f0c38940>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:07.592930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-826da478-0fbd-4e29-97a3-5e3d8c0c69bb tempest-TestMinimumBasicScenario-1038242888 tempest-TestMinimumBasicScenario-1038242888-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1237448761" status: 202 len: 0 microversion: 2.1 time: 0.086854 Jul 27 08:45:07.593793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 294/576] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Jul 27 08:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1237448761 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:45:07.847031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:07.847658 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:07.857833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:07.858392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:07.859248 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:07.859768 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:08.003686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:08.012482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1e389073-d2cd-4ef1-8a2f-8318b8a1a9d8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.169537 Jul 27 08:45:08.013065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 283/577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:07 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:08.028203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:08.029648 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:08.041195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:08.041195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:08.041195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:08.041195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:08.052168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 HTTP/1.1 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:45:08.053742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:45:08.055451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '73303fae-c87c-4ca8-86ef-f53a66bb47d9'} Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:08.056293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:45:08.057699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:08.058954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:08.058954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-041392ac-ac4b-48ae-a623-4382a1ec0814 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 404 len: 111 microversion: 2.20 time: 0.038147 Jul 27 08:45:08.058954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 295/578] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:08 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:45:08.064167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-eb31570c-2311-4d4f-b2c8-5e246abaa581 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '.version_select at 0x7f78f0b0edc0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:08.077765 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-d62f8f63-2f8a-42de-87fe-d2c4c129d0cb req-1cdf15d0-3e91-437a-99fc-de673b2bf780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73303fae-c87c-4ca8-86ef-f53a66bb47d9", "name": "network-vif-deleted", "tag": "e8a0e0d3-038b-475c-b988-cb677e787e58"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:08.087278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-d62f8f63-2f8a-42de-87fe-d2c4c129d0cb req-1cdf15d0-3e91-437a-99fc-de673b2bf780 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:08.087708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-d62f8f63-2f8a-42de-87fe-d2c4c129d0cb req-1cdf15d0-3e91-437a-99fc-de673b2bf780 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:08.101221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-d62f8f63-2f8a-42de-87fe-d2c4c129d0cb req-1cdf15d0-3e91-437a-99fc-de673b2bf780 service nova] Creating event network-vif-deleted:e8a0e0d3-038b-475c-b988-cb677e787e58 for instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 on hv-cinder-85117 Jul 27 08:45:08.106081 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-d62f8f63-2f8a-42de-87fe-d2c4c129d0cb req-1cdf15d0-3e91-437a-99fc-de673b2bf780 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032637 Jul 27 08:45:08.106705 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 296/579] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:08.143198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-eb31570c-2311-4d4f-b2c8-5e246abaa581 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444867662" status: 204 len: 0 microversion: 2.20 time: 0.083007 Jul 27 08:45:08.143832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 284/580] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Jul 27 08:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444867662 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 08:45:08.961864 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-01801cbb-ac38-459a-b9e0-ed5f314137e1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: .version_select at 0x7f78f0d2e160>, body: {"keypair": {"name": "tempest-keypair-603783285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABf1iDLYIhd3dNltfObu2Y0q5Q9VfAW+S9ENG8mstJNiT3GokatcuBiUyBk46uyXj7EyLmWLocpE2mSDN2pkKG/Zrx+9r2OMymOnc8pRw8c48gcT94jSXz/AcS1XPekKA=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:08.979017 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-01801cbb-ac38-459a-b9e0-ed5f314137e1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:08.984062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-01801cbb-ac38-459a-b9e0-ed5f314137e1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for user 26128a80933f4be3bed504d7a2d2785f and project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:09.036931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:09.037549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:09.045168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:09.045949 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:09.046919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:09.047366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:09.059919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-01801cbb-ac38-459a-b9e0-ed5f314137e1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.105987 Jul 27 08:45:09.061498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 297/581] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Jul 27 08:45:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 27 08:45:09.307214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:09.318871 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-83a02682-fdd9-422e-8888-8cf7443cfb1d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.287630 Jul 27 08:45:09.320848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 285/582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:09 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:10.265569 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2102943082", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f6980da-175b-4e92-9032-637e0458eb4f"}], "security_groups": [{"name": "tempest-securitygroup--1230717604"}], "key_name": "tempest-keypair-927699050", "user_data": "}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:10.341023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:10.342636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:10.350341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:10.350905 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:10.351784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:10.352274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:10.357874 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:10.437089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] validate_networks() for [('8f6980da-175b-4e92-9032-637e0458eb4f', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:45:10.492652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:10.500760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ac0ec544-0a46-4336-8482-a7152c6aeccd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.163535 Jul 27 08:45:10.501326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 286/583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:10 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:11.218318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:45:11.218794 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:45:11.219533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:45:11.220624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:45:11.221768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:45:11.235163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:11.235608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:11.236400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:11.236829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:11.255735 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:11.257969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:11.260360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:11.273083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:45:11.275645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:45:11.410206 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-47a59a81-41fb-45dd-8e14-ba3fd7484af6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.149390 Jul 27 08:45:11.411221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 298/584] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:45:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:45:11.425064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-18e5dd91-882a-4578-b043-d88eac905c0d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:11.425661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-18e5dd91-882a-4578-b043-d88eac905c0d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:11.522717 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:11.524418 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:11.538793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:11.539543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:11.541233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:11.541871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:11.542876 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-18e5dd91-882a-4578-b043-d88eac905c0d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:11.557777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-18e5dd91-882a-4578-b043-d88eac905c0d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1241 microversion: 2.1 time: 0.136416 Jul 27 08:45:11.562465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 287/585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:11 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:11.750452 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:11.760309 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2d5843f-f933-4415-8ba3-a0624c347597 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1735 microversion: 2.1 time: 0.241595 Jul 27 08:45:11.761565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 299/586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:11 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:12.396420 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-423995088", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77554b81-fd19-4316-8d69-62980152360c"}], "security_groups": [{"name": "tempest-securitygroup--854396027"}], "key_name": "tempest-keypair-603783285", "user_data": "}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:12.582748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:12.583601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:12.590768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:12.591293 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:12.592586 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:12.593094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:12.645141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] validate_networks() for [('77554b81-fd19-4316-8d69-62980152360c', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:45:12.656987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:12.665072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5cea5717-6349-43d9-bf0e-1c0c579402db tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1245 microversion: 2.1 time: 0.086198 Jul 27 08:45:12.665645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 300/587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:12 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:12.782667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:12.783612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:12.789637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:12.790095 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:12.790875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:12.791299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.013093 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:13.022684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a12f0011-b856-442c-8e34-4ccb130abb36 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1715 microversion: 2.1 time: 0.244070 Jul 27 08:45:13.023559 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 301/588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:12 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1715 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:13.087335 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:13.088215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:13.096147 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.096634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.103273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.103273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.151405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:45:13.151830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:45:13.152337 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:45:13.152745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:45:13.153384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:45:13.162894 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.163495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.164399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.164867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.183238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:13.187390 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] HTTP exception thrown: Cannot 'detach_volume' instance 8f053d88-ea01-4efa-9bcc-0880e6194203 while it is in vm_state rescued Jul 27 08:45:13.188225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Getting quotas for user 26128a80933f4be3bed504d7a2d2785f and project e2c60f49a9e14417bd1d9504128fc94b. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Request method failure captured: Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments/21badbd2-32bb-4f61-84b8-6ec0b9ccc281 HTTP/1.1 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Poed2m8e69flYFSd76bDHPzFAvbBDz0NIQR3bxJyeHiUTQgRCTQdAXpdTUjnKoFDkAxZcZu6KtweqBZXFLCVqFIB3aX8t6QKBeIJdbiN9TH1b85l_SdtoABrHNSrLo-vVUjPGn4ojSiltHh4kdxwRf4Nwzge37SZIWDqEmRqOTYGzs Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:45:13.188460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0d880114866423480268022d7dd20c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0d880114866423480268022d7dd20c5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 906ca078a25447b3b9c01f4fc76e7090 Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:45:13.189740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Cannot 'detach_volume' instance 8f053d88-ea01-4efa-9bcc-0880e6194203 while it is in vm_state rescued Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'server_id': '8f053d88-ea01-4efa-9bcc-0880e6194203', 'id': '21badbd2-32bb-4f61-84b8-6ec0b9ccc281'} Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:13.190455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8f053d88-ea01-4efa-9bcc-0880e6194203 while it is in vm_state rescued Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8f053d88-ea01-4efa-9bcc-0880e6194203 while it is in vm_state rescued Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:45:13.192818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Returning 409 to user: Cannot 'detach_volume' instance 8f053d88-ea01-4efa-9bcc-0880e6194203 while it is in vm_state rescued {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:13.194635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bd53ba51-0ff9-48ea-a8ad-c012afc99718 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments/21badbd2-32bb-4f61-84b8-6ec0b9ccc281" status: 409 len: 152 microversion: 2.1 time: 0.107183 Jul 27 08:45:13.194635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 302/589] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:45:13 2022] DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments/21badbd2-32bb-4f61-84b8-6ec0b9ccc281 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 08:45:13.203335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:45:13.203930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:13.204631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:13.210346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:45:13.212142 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.212584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.213352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.213780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.405278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e6a7a95b-177d-4159-b6c0-afd82e1fbafa tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.013100 Jul 27 08:45:13.406259 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 288/590] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Jul 27 08:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 08:45:13.438334 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:13.438960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:13.512060 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:13.521747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:13.524064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:13.525582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-87926f55-d366-4384-a5f9-c777ecf61ef2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1280 microversion: 2.20 time: 0.111343 Jul 27 08:45:13.526750 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 289/591] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:13 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:13.571767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a3dd429b-43b0-44dd-b805-4bc29bfbb203 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/action" status: 202 len: 0 microversion: 2.1 time: 0.372040 Jul 27 08:45:13.575435 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 303/592] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:45:13 2022] POST /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:45:13.586478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:13.587564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:13.598926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.599402 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.600600 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.601282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.688751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:13.689635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:13.696935 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.697629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.698740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:13.699331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:13.777827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:13.791193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fe8fc9b5-a47b-450a-bbe3-398145862ef1 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1293 microversion: 2.1 time: 0.108035 Jul 27 08:45:13.791969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 304/593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:13 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:14.214252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:14.222318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-af71293a-0da8-4b14-82d3-ba6f3cfc75d6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1723 microversion: 2.1 time: 0.642626 Jul 27 08:45:14.223168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 290/594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:13 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:14.549511 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:14.550124 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:14.558475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:14.558925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:14.559706 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:14.560744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:14.627139 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:14.635501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:14.637037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:14.638275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7d494ca4-7a33-4a4f-8260-f05213091f74 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1284 microversion: 2.20 time: 0.093686 Jul 27 08:45:14.638840 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 305/595] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:14 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:14.821542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:14.822273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:14.829103 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:14.829652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:14.830656 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:14.831164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:14.954466 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:14.961983 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0e4d3f09-e863-4c1c-9eba-70b1e0660c9d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1299 microversion: 2.1 time: 0.144163 Jul 27 08:45:14.962789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 291/596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:14 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:15.244961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:15.245510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:15.252801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.253256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:15.254028 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.254482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:15.390687 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:15.398735 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9516443b-e3ac-420c-b88a-a724f7866bc0 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1723 microversion: 2.1 time: 0.157694 Jul 27 08:45:15.399552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 306/597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:15 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:15.660846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:15.661435 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:15.667726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.668167 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:15.668934 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.669365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:15.983972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:15.984579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:15.991069 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:15.991324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.991776 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:15.992546 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:15.993039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:16.003489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:16.005608 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:16.006971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-636edd4c-b632-4f60-af5a-d454a2bb263e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1340 microversion: 2.20 time: 0.350112 Jul 27 08:45:16.007523 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 292/598] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:15 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1340 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:16.065953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:16.073330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ac3c614b-5951-49ba-9bc2-c8718aa4ede2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1299 microversion: 2.1 time: 0.093966 Jul 27 08:45:16.074085 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 307/599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:15 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:16.422469 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:16.424195 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:16.431867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:16.432409 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:16.433129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:16.433581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:16.674904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:16.683910 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0184776b-5ae4-4eaa-8c05-e67d5a7095dc tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1723 microversion: 2.1 time: 0.266932 Jul 27 08:45:16.684393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 293/600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:16 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:17.031030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:17.031638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:17.038111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.038595 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.039354 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.039791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.095568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:17.096183 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:17.102059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:17.103007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.103453 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.104471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.105065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.110924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:17.112594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:17.113727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f8cba611-61bd-4ec5-95ea-f8c029a16d91 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1350 microversion: 2.20 time: 0.087770 Jul 27 08:45:17.114520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 308/601] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:17 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:17.338130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:17.345681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-128f6041-4754-4687-a8a8-58fb875bac8f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.254851 Jul 27 08:45:17.346564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 294/602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:17 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:17.708090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:17.708255 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:17.714911 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.715661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.717089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:17.717744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:17.898042 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:17.901619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:17.916612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-051efb1f-1cc1-4f33-87a3-07c3e54f06ca tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1723 microversion: 2.1 time: 0.213768 Jul 27 08:45:17.917530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 309/603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:17 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:18.139165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:18.140424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:18.154376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.155097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.165331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.165539 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.238746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:18.248773 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:18.250608 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:18.251970 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2e8ec23e-752d-475f-8129-717f35716f18 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1338 microversion: 2.20 time: 0.118878 Jul 27 08:45:18.252614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 295/604] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:18 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1338 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:45:18.368760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:18.368760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:18.378078 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.378549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.380005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.380443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.559406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-44119152-3654-4959-8c61-fb2b7a1795c7 req-95bb0d82-d7ad-44b0-af19-94e5ebf0e9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159ef74b-f7ad-4522-a24f-174383d37309", "tag": "59ab739b-608a-4deb-9d9c-07a3e116ee2e"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:18.585399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-44119152-3654-4959-8c61-fb2b7a1795c7 req-95bb0d82-d7ad-44b0-af19-94e5ebf0e9a7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.590570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-44119152-3654-4959-8c61-fb2b7a1795c7 req-95bb0d82-d7ad-44b0-af19-94e5ebf0e9a7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.615140 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-44119152-3654-4959-8c61-fb2b7a1795c7 req-95bb0d82-d7ad-44b0-af19-94e5ebf0e9a7 service nova] Creating event network-changed:59ab739b-608a-4deb-9d9c-07a3e116ee2e for instance 159ef74b-f7ad-4522-a24f-174383d37309 on hv-cinder-85117 Jul 27 08:45:18.618661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-44119152-3654-4959-8c61-fb2b7a1795c7 req-95bb0d82-d7ad-44b0-af19-94e5ebf0e9a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065557 Jul 27 08:45:18.619590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 296/605] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:45:18.679659 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:18.688867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1f552ed5-e65d-4aec-b35c-813b70e1672d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.326089 Jul 27 08:45:18.689398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 310/606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:18 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:18.941214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:18.942495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:18.949920 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.951481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:18.952575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:18.953265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.168685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:19.179761 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6e8f66b8-e8c9-4f5d-ace4-3837b20ac6ef tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1729 microversion: 2.1 time: 0.242643 Jul 27 08:45:19.180653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 297/607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:18 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:19.203444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:19.204301 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:19.211009 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.211567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.212815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.213446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.276903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:19.277516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:19.289262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.290319 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.291325 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.291953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.320990 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-61564bac-dbed-4b60-8015-96c032cf5f6d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123134 Jul 27 08:45:19.321584 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 311/608] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:45:19 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:19.711128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:19.711994 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:19.719195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.720041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.721068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:19.721719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:19.946311 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:19.959273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:19.963159 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:19.966488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b8fb0964-3483-4994-b5db-5fad34bf975b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.691411 Jul 27 08:45:19.974403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 298/609] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:19 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:20.112141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:20.121897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0374a7dd-1470-40ff-b737-dea8dfb3a39a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.415010 Jul 27 08:45:20.124371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 312/610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:19 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:20.635076 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-e9397a4c-2115-4b18-8101-232efdcd3dc0 req-2345a4d3-8ab9-41e1-8c80-9537d42007a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:20.648907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e9397a4c-2115-4b18-8101-232efdcd3dc0 req-2345a4d3-8ab9-41e1-8c80-9537d42007a1 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:20.649362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e9397a4c-2115-4b18-8101-232efdcd3dc0 req-2345a4d3-8ab9-41e1-8c80-9537d42007a1 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:20.662963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-e9397a4c-2115-4b18-8101-232efdcd3dc0 req-2345a4d3-8ab9-41e1-8c80-9537d42007a1 service nova] Creating event network-changed:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:45:20.672062 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-e9397a4c-2115-4b18-8101-232efdcd3dc0 req-2345a4d3-8ab9-41e1-8c80-9537d42007a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038729 Jul 27 08:45:20.673583 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 299/611] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:20.989245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:20.990445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:20.993806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-62045c69-e89e-4b83-b359-2d1588652242 req-de76e888-14a5-441d-9699-16294f958c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:20.999164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:20.999889 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:21.000969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:21.001619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:21.008887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-62045c69-e89e-4b83-b359-2d1588652242 req-de76e888-14a5-441d-9699-16294f958c77 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:21.009346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-62045c69-e89e-4b83-b359-2d1588652242 req-de76e888-14a5-441d-9699-16294f958c77 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:21.030470 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-62045c69-e89e-4b83-b359-2d1588652242 req-de76e888-14a5-441d-9699-16294f958c77 service nova] Creating event network-changed:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:45:21.036053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-62045c69-e89e-4b83-b359-2d1588652242 req-de76e888-14a5-441d-9699-16294f958c77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048009 Jul 27 08:45:21.036663 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 300/612] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:45:21.145177 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:21.145821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:21.153674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:21.153918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:21.153918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:21.154185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:21.154543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:21.161976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:21.163663 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:21.164896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-dcb7d740-806d-44c0-97e9-df1f6407140e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.179861 Jul 27 08:45:21.165464 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 313/613] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:20 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:21.304134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:21.313076 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f948eb43-42b5-4357-bcf7-0e1aa6455ace tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.172653 Jul 27 08:45:21.313649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 301/614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:21 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:22.189261 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:22.189640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:22.191460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:22.192125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=14 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:22.197279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:22.197719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:22.198495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:22.199232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:22.332326 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:22.334037 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:22.334854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:22.341030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:22.341791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:22.342267 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:22.342590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:22.343042 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:22.343656 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:22.343764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a3304d7f-12d9-415c-9264-ede3c8b22243 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.159948 Jul 27 08:45:22.350239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 314/615] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:22 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:22.492535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:22.500142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1582c79c-69b7-4143-91cc-486bc80c53af tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.170258 Jul 27 08:45:22.500727 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 302/616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:22 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:23.055748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-4858ed19-ea56-40bf-ac4e-7c2a2b6951cf req-7c6f6da0-3438-4a6b-a2bc-a2005f5b3eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:23.074661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4858ed19-ea56-40bf-ac4e-7c2a2b6951cf req-7c6f6da0-3438-4a6b-a2bc-a2005f5b3eed service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:23.075097 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4858ed19-ea56-40bf-ac4e-7c2a2b6951cf req-7c6f6da0-3438-4a6b-a2bc-a2005f5b3eed service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:23.090688 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-4858ed19-ea56-40bf-ac4e-7c2a2b6951cf req-7c6f6da0-3438-4a6b-a2bc-a2005f5b3eed service nova] Creating event network-changed:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:45:23.098013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-4858ed19-ea56-40bf-ac4e-7c2a2b6951cf req-7c6f6da0-3438-4a6b-a2bc-a2005f5b3eed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045475 Jul 27 08:45:23.102057 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 315/617] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:23.367126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:23.367710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:23.369648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:23.375067 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:23.375520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:23.376271 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:23.376723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:23.510919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:23.517388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=10 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:23.521221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:23.522360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:23.522866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:23.523189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:23.523832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7c94c980-921c-4945-a9d3-54f9dd70875a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.160770 Jul 27 08:45:23.524375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 303/618] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:23 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:23.530646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:23.531181 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:23.532015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:23.532517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:23.706789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:23.720106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-daf5823c-8db2-4f4b-bdc5-2c383cc9f1a3 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.202501 Jul 27 08:45:23.721264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 316/619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:23 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:24.548049 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:24.548867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:24.556391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:24.556838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:24.557608 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:24.558044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:24.712709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:24.720848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:24.722384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:24.723456 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-02326b49-190d-4c4b-9d38-555cb6d07ab0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.180066 Jul 27 08:45:24.724073 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 304/620] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:24 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:24.741854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:24.742482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:24.749787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:24.750259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:24.751011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:24.751442 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:24.949287 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:24.957361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-214fa7e2-b911-443e-b734-f4cddb933f26 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.219317 Jul 27 08:45:24.957922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 317/621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:24 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:25.746847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:25.749690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:25.751391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:25.756903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:25.757975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:25.758877 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:25.759463 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:25.904234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:25.914602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:25.916278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:25.917406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e5ed836c-91f8-4991-b5fc-d541cbacc58c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.175317 Jul 27 08:45:25.918780 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 305/622] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:25 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:25.990273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:25.990904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:26.000779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:26.001224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:26.004563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:26.005013 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:26.122160 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-85ab8668-e910-4f10-8bae-4c5068084fd2 req-069d714d-bccb-480c-b269-74fd133da8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159ef74b-f7ad-4522-a24f-174383d37309", "name": "network-vif-plugged", "status": "completed", "tag": "59ab739b-608a-4deb-9d9c-07a3e116ee2e"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:26.136370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-85ab8668-e910-4f10-8bae-4c5068084fd2 req-069d714d-bccb-480c-b269-74fd133da8e7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:26.136880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-85ab8668-e910-4f10-8bae-4c5068084fd2 req-069d714d-bccb-480c-b269-74fd133da8e7 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:26.151163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-85ab8668-e910-4f10-8bae-4c5068084fd2 req-069d714d-bccb-480c-b269-74fd133da8e7 service nova] Creating event network-vif-plugged:59ab739b-608a-4deb-9d9c-07a3e116ee2e for instance 159ef74b-f7ad-4522-a24f-174383d37309 on hv-cinder-85117 Jul 27 08:45:26.156699 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-85ab8668-e910-4f10-8bae-4c5068084fd2 req-069d714d-bccb-480c-b269-74fd133da8e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221509 Jul 27 08:45:26.157381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 318/623] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:45:26.189180 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:26.201880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4edf8663-56fd-4675-ba04-eecfdeac36d7 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.225958 Jul 27 08:45:26.202893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 306/624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:25 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:26.943653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:26.944585 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:26.954415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:26.962290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:26.962290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:26.962290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:27.224392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:27.225624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:27.232861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:27.233519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:27.234359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:27.234794 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:27.254044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:27.255044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:27.264302 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:27.271075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:27.271075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c9cd166d-b297-44e2-9f18-052467ade4eb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.330136 Jul 27 08:45:27.271075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 319/625] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:26 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:27.388604 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:27.396827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7678f49c-a758-4354-8010-5b8b8ecfc4c2 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.176287 Jul 27 08:45:27.407808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 307/626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:27 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:28.291601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:28.292790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:28.301401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:28.302427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:28.303221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:28.303690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:28.421429 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:28.422823 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:28.437172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:28.437569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:28.438544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:28.439040 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:28.553614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:28.562696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:28.564605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:28.565960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-da48bcfe-9793-449f-93ea-02b98d03bb0d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.278990 Jul 27 08:45:28.566886 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 320/627] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:28 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:28.637235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:28.645449 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-319d29fa-a9d7-49bf-922c-5858cc307737 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1367 microversion: 2.1 time: 0.230548 Jul 27 08:45:28.646155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 308/628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:28 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:29.590535 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:29.591913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:29.598761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.599206 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.599980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.600595 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.666251 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:29.668267 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:29.676490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.677153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.678117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.678981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.854286 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:29.859770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:29.869079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0da17841-1d51-4878-a1dd-5e8e1dff4c59 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1558 microversion: 2.1 time: 0.205446 Jul 27 08:45:29.869193 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:29.869331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 309/629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:29 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:29.872952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:29.873923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2673d3d5-9494-47ed-80e4-1a02420ec5f2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.287554 Jul 27 08:45:29.874695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 321/630] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:29 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:29.892476 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:29.893470 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:29.899945 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.900543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.901327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:29.901763 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:29.991857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1a0e9df4-bece-4255-9f63-b6228a86ca7b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103234 Jul 27 08:45:29.992458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 310/631] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:45:29 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:30.088882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-08ff1305-4bca-446b-92d1-143f26b1a20d req-38d76bd6-7e47-4e0e-876b-5d8b4e98e786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "name": "network-vif-plugged", "status": "completed", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:30.100710 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-08ff1305-4bca-446b-92d1-143f26b1a20d req-38d76bd6-7e47-4e0e-876b-5d8b4e98e786 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:30.101477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-08ff1305-4bca-446b-92d1-143f26b1a20d req-38d76bd6-7e47-4e0e-876b-5d8b4e98e786 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:30.117099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-08ff1305-4bca-446b-92d1-143f26b1a20d req-38d76bd6-7e47-4e0e-876b-5d8b4e98e786 service nova] Creating event network-vif-plugged:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:45:30.122951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-08ff1305-4bca-446b-92d1-143f26b1a20d req-38d76bd6-7e47-4e0e-876b-5d8b4e98e786 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038537 Jul 27 08:45:30.123912 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 322/632] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:30.897666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:30.898298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:30.905126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:30.907670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:30.907670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:30.907670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:31.069824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:31.082529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:31.084657 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:31.086302 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f45a8df4-ebaa-4f3c-b903-c61d0cab70f8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.193137 Jul 27 08:45:31.088113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 311/633] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:30 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:31.332093 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-4b32d5ca-67d0-4d3a-a146-cede2fdca51f req-22598349-f3f9-44aa-a8d5-afcd8685b7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159ef74b-f7ad-4522-a24f-174383d37309", "tag": "59ab739b-608a-4deb-9d9c-07a3e116ee2e"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:31.349890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4b32d5ca-67d0-4d3a-a146-cede2fdca51f req-22598349-f3f9-44aa-a8d5-afcd8685b7e8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:31.350388 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4b32d5ca-67d0-4d3a-a146-cede2fdca51f req-22598349-f3f9-44aa-a8d5-afcd8685b7e8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:31.365207 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-4b32d5ca-67d0-4d3a-a146-cede2fdca51f req-22598349-f3f9-44aa-a8d5-afcd8685b7e8 service nova] Creating event network-changed:59ab739b-608a-4deb-9d9c-07a3e116ee2e for instance 159ef74b-f7ad-4522-a24f-174383d37309 on hv-cinder-85117 Jul 27 08:45:31.370592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-4b32d5ca-67d0-4d3a-a146-cede2fdca51f req-22598349-f3f9-44aa-a8d5-afcd8685b7e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042508 Jul 27 08:45:31.371445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 323/634] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:32.112984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:32.113660 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:32.124575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:32.125031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:32.125884 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:32.127096 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:32.306247 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:32.328605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:32.330230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:32.335690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b39834b1-9fc2-4200-b9af-66c7cbd6f8bb tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1405 microversion: 2.20 time: 0.226872 Jul 27 08:45:32.355835 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 312/635] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:32 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:33.360702 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:33.361394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:33.368915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:33.369604 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:33.370434 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:33.370857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:33.674529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:33.682800 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:33.685288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:33.686872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7c2173a3-6f3f-4471-bcfe-b4b5cb604953 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1598 microversion: 2.20 time: 0.330942 Jul 27 08:45:33.688304 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 324/636] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:45:33 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1598 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:45:33.710847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:33.711434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:33.724157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:33.727442 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:33.727442 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:33.727442 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:33.840222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-db3ec0b6-bb91-4750-bd1f-53e66cadb6e2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124019 Jul 27 08:45:33.840222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 313/637] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Jul 27 08:45:33 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:45:35.817070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-12012abf-6e50-42d3-9579-2801f94544e0 req-67d03e95-f152-474a-a718-c3966e1e6385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:35.837677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-12012abf-6e50-42d3-9579-2801f94544e0 req-67d03e95-f152-474a-a718-c3966e1e6385 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:35.841669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-12012abf-6e50-42d3-9579-2801f94544e0 req-67d03e95-f152-474a-a718-c3966e1e6385 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:35.855361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-12012abf-6e50-42d3-9579-2801f94544e0 req-67d03e95-f152-474a-a718-c3966e1e6385 service nova] Creating event network-changed:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:45:35.862723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-12012abf-6e50-42d3-9579-2801f94544e0 req-67d03e95-f152-474a-a718-c3966e1e6385 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055146 Jul 27 08:45:35.863975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 325/638] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:38.089883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-91bf13d6-0f07-43db-a455-2df419cfce25 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Action: 'create', calling method: .version_select at 0x7f78f152dd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1955969943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaDw4K2t5r5hFZA0e/sei0WwY7s8V5eB2iecS8VD7y9ELs2XysxZ517f6Tb47w1L4gpascXw3BE7EBLqAdUGrk6JRubBBIzl2XayoDvrZzhccUlLhpg6if/1P/7mo+B3w=="}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:38.111632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-91bf13d6-0f07-43db-a455-2df419cfce25 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Getting quotas for project 5d10772d974f47d7bc82c0f0b8a8facf. Resources: {'key_pairs'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:38.115496 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-91bf13d6-0f07-43db-a455-2df419cfce25 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Getting quotas for user 7b63aaa3a9db4fa4b50bf93eae5a1ffc and project 5d10772d974f47d7bc82c0f0b8a8facf. Resources: {'key_pairs'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:38.203984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-91bf13d6-0f07-43db-a455-2df419cfce25 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.293079 Jul 27 08:45:38.204587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 314/639] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:45:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:43.495648 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:43.498054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:43.500825 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:43.506118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.506625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:43.507478 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.507950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:43.540407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a8ebe9fd-5b07-409f-b091-24b0b6bafe35 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049621 Jul 27 08:45:43.540982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 326/640] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:45:43 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:45:43.608082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:43.608709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:43.616461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.616917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:43.617743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.618215 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:43.644194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:45:43.945285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-06ad88eb-b066-4eb0-91e9-c35eb77918d8 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 204 len: 0 microversion: 2.1 time: 0.341381 Jul 27 08:45:43.946256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 315/641] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:45:43 2022] DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:45:43.955385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:43.955996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:43.962978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.963172 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:43.963894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:43.964336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:44.109661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:44.116827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-15cd8dcb-ec59-4a67-9056-9fe0f401ef74 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1671 microversion: 2.1 time: 0.166126 Jul 27 08:45:44.117437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 327/642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:43 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:45.139734 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:45.140484 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:45.147289 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:45.147737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:45.150605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:45.150605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:45.285376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:45.293511 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8b2f245c-282d-4b63-ad3c-884db32d43bd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1671 microversion: 2.1 time: 0.158976 Jul 27 08:45:45.294993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 316/643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:45 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:46.318161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:46.318866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:46.328784 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:46.329545 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:46.331471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:46.332434 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:46.405056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:46.412890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-786eb70b-0d61-4944-9fa1-3c33b7e424bb tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1604 microversion: 2.1 time: 0.099964 Jul 27 08:45:46.413786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 328/644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:46 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:46.477743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-c3ed809b-7d0d-4d8a-82d0-719311f4fb63 req-ae44d2e7-09d6-4624-8be8-3764a7e078d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7739cba-0102-4d24-ac1e-904912fe2c65", "name": "network-vif-deleted", "tag": "535f88dd-47a5-428c-ab18-ca28f688244a"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:46.492705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-c3ed809b-7d0d-4d8a-82d0-719311f4fb63 req-ae44d2e7-09d6-4624-8be8-3764a7e078d2 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:46.493156 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-c3ed809b-7d0d-4d8a-82d0-719311f4fb63 req-ae44d2e7-09d6-4624-8be8-3764a7e078d2 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:46.506295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-c3ed809b-7d0d-4d8a-82d0-719311f4fb63 req-ae44d2e7-09d6-4624-8be8-3764a7e078d2 service nova] Creating event network-vif-deleted:535f88dd-47a5-428c-ab18-ca28f688244a for instance f7739cba-0102-4d24-ac1e-904912fe2c65 on hv-cinder-85117 Jul 27 08:45:46.511407 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-c3ed809b-7d0d-4d8a-82d0-719311f4fb63 req-ae44d2e7-09d6-4624-8be8-3764a7e078d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037539 Jul 27 08:45:46.512251 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 317/645] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:47.436281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:47.441402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:47.448069 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:47.448515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:47.449285 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:47.449715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:47.482792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:47.483241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:47.483687 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lazy-loading 'fault' on Instance uuid f7739cba-0102-4d24-ac1e-904912fe2c65 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:45:47.529394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:47.533114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:47.537682 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1b5ccdc0-a387-4792-b7ac-6f9ffdc20ad7 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 200 len: 1327 microversion: 2.1 time: 0.105794 Jul 27 08:45:47.538709 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 329/646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:47 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:48.558499 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=4 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:48.562746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:48.563467 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:48.569997 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:48.575570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:48.575570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:48.575570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:48.586006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 HTTP/1.1 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:45:48.587975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:45:48.589558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'f7739cba-0102-4d24-ac1e-904912fe2c65'} Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:45:48.590594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:45:48.593144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:45:48.594557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:45:48.594557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0f074724-8aaf-4705-a257-6da7c62ef9d2 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 404 len: 111 microversion: 2.1 time: 0.032444 Jul 27 08:45:48.594557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 318/647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:48 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:45:48.599446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0e584de8-379c-4694-99d8-ad31eae7b122 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '.version_select at 0x7f78f0be9310>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:48.699777 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0e584de8-379c-4694-99d8-ad31eae7b122 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208725782" status: 202 len: 0 microversion: 2.1 time: 0.104481 Jul 27 08:45:48.700968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 330/648] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Jul 27 08:45:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208725782 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:45:49.484769 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d3538c76-f212-498a-9d54-1adb4bfb2c48 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: .version_select at 0x7f78f0b3f160>, body: {"keypair": {"name": "tempest-keypair-138000664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv7wbELgenEBgRIWZrsz3gKlpNnwHLrMqJx1qmsniqopwXpof25PSW2JURQsDpSmR6zLx4lMYpWWIn/YmD3TrztdShOxWhYGv016bzBZxdnPpPjdSDenIqzflXbGLeWFQ=="}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:49.500640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-d3538c76-f212-498a-9d54-1adb4bfb2c48 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'key_pairs'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:49.504490 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-d3538c76-f212-498a-9d54-1adb4bfb2c48 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for user c29a83c5d2ce48eda587f2cec0e959ce and project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'key_pairs'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:49.640385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d3538c76-f212-498a-9d54-1adb4bfb2c48 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160074 Jul 27 08:45:49.641047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 319/649] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:45:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:51.826073 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1912589695", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86596533-e5bc-41a5-8bd8-3e19070777ca"}], "security_groups": [{"name": "tempest-securitygroup--1714038666"}], "key_name": "tempest-keypair-138000664", "user_data": "}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:51.932264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] validate_networks() for [('86596533-e5bc-41a5-8bd8-3e19070777ca', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:45:52.317232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:45:52.317992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:45:52.318671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:45:52.319072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:45:52.319504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:45:52.328818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:52.329323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:52.330035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:52.330488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:52.349142 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:45:52.353482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Getting quotas for user c29a83c5d2ce48eda587f2cec0e959ce and project 9dcfebb6e1774a7daed20b60d2379875. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:45:52.365257 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:45:52.367594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:45:52.486072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9cf0059d-17fb-4025-9610-81221e075e1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664910 Jul 27 08:45:52.486830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 331/650] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:45:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:45:52.498434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0858530b-37f1-4edf-b12b-1505c0e8478f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:52.499077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0858530b-37f1-4edf-b12b-1505c0e8478f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:52.556992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0858530b-37f1-4edf-b12b-1505c0e8478f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:52.564117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0858530b-37f1-4edf-b12b-1505c0e8478f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1237 microversion: 2.1 time: 0.070189 Jul 27 08:45:52.564681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 320/651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:52 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:53.585475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:53.586069 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:53.592416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:53.592855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:53.593664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:53.594118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:53.654533 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:53.662218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-af0ba52b-ba47-43ad-a913-200a27c5e9c5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1241 microversion: 2.1 time: 0.081232 Jul 27 08:45:53.662807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 332/652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:53 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:54.683512 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:54.684124 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:54.691350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:54.691799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:54.692562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:54.692998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:54.768539 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:54.776143 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6d1f7e2d-cfe9-4455-b11c-acfdd8c34e3a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1297 microversion: 2.1 time: 0.096640 Jul 27 08:45:54.777284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 321/653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:54 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:55.797245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:55.797842 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:55.804527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:55.804980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:55.805748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:55.806218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:55.934541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:55.944999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d8f6f703-a8e8-4d7a-8843-743c10c819ff tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.151837 Jul 27 08:45:55.945530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 333/654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:55 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:56.304622 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-13d6bd18-3f2d-41e7-95d7-a144a3a2ad28 req-64cf5331-7f41-4c36-a0b0-0682c3c32c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b9d72-4d03-452a-9680-0724288c3351", "tag": "6323d0f2-9c69-4ebc-8c31-26281bc1b864"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:45:56.312946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:56.317818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-13d6bd18-3f2d-41e7-95d7-a144a3a2ad28 req-64cf5331-7f41-4c36-a0b0-0682c3c32c0d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:56.317818 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-13d6bd18-3f2d-41e7-95d7-a144a3a2ad28 req-64cf5331-7f41-4c36-a0b0-0682c3c32c0d service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:56.328740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-13d6bd18-3f2d-41e7-95d7-a144a3a2ad28 req-64cf5331-7f41-4c36-a0b0-0682c3c32c0d service nova] Creating event network-changed:6323d0f2-9c69-4ebc-8c31-26281bc1b864 for instance 198b9d72-4d03-452a-9680-0724288c3351 on hv-cinder-85117 Jul 27 08:45:56.333679 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-13d6bd18-3f2d-41e7-95d7-a144a3a2ad28 req-64cf5331-7f41-4c36-a0b0-0682c3c32c0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032903 Jul 27 08:45:56.334616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 322/655] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:45:56.966391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:56.967002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:56.973377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:56.973841 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:56.974624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:56.975059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:57.102191 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:57.109562 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4a46aba8-a99c-4a4f-b910-5dc8f423bd3d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.147333 Jul 27 08:45:57.110121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 334/656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:56 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:45:58.132589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:58.133276 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:58.139941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:58.140391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:58.141139 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:58.141574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:58.144172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:45:58.275678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:58.283206 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-05d132e2-d4e2-430e-b2e9-678881708e39 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.155566 Jul 27 08:45:58.283781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 323/657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:58 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:45:59.304823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:45:59.305476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:45:59.311938 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:59.312379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:59.313125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:45:59.313556 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:45:59.448514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:45:59.457920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8ed2dfeb-4da5-4551-80d6-63eda4f31996 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.156862 Jul 27 08:45:59.458788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 335/658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:45:59 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:00.489811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:00.490434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:00.497960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:00.498438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:00.499238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:00.499673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:00.627170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:00.634425 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c7558595-df89-4cf3-966f-d7932af9257e tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.148542 Jul 27 08:46:00.634977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 324/659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:00 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:01.654420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:01.655019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:01.661924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:01.662407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:01.663163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:01.663596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:01.788232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:01.795600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1997531a-fad3-44c0-b16c-9d2b89d1e350 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.144888 Jul 27 08:46:01.796695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 336/660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:01 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:02.817282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:02.817897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:02.820277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:02.825118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:02.825568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:02.826374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:02.826814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:02.958973 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:02.966835 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-196cc6bb-3d2f-4c65-ad92-52b657a15f14 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.153388 Jul 27 08:46:02.967420 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 325/661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:02 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:03.988099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:03.988683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:03.990686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:03.991357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:03.996813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:03.997262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:03.998036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:03.998490 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:04.140601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:04.148321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-be4e0f54-1ab4-407b-b9c0-92d5e051326c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.164378 Jul 27 08:46:04.148885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 337/662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:03 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:05.170410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:05.171613 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:05.178465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:05.178917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:05.179679 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:05.180114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:05.308261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:05.315834 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-94106693-390f-44be-8310-b77f007bc4c6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.149576 Jul 27 08:46:05.316401 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 326/663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:05 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:05.805779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-540202812", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1955969943", "security_groups": [{"name": "tempest-secgroup-smoke-1962300602"}], "networks": [{"uuid": "93238f62-e429-47ef-8e5c-b2b7247c1c0f"}], "block_device_mapping_v2": [{"uuid": "079997df-4eaa-40c2-8378-92b36f6938fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:05.917217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] validate_networks() for [('93238f62-e429-47ef-8e5c-b2b7247c1c0f', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:46:06.160114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-0806fef5-d413-4f23-8ce5-cb937f9aee2d req-08ffbd30-864f-4e6a-baae-606c01c1886a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b9d72-4d03-452a-9680-0724288c3351", "name": "network-vif-plugged", "status": "completed", "tag": "6323d0f2-9c69-4ebc-8c31-26281bc1b864"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:06.170549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-0806fef5-d413-4f23-8ce5-cb937f9aee2d req-08ffbd30-864f-4e6a-baae-606c01c1886a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:06.176272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-0806fef5-d413-4f23-8ce5-cb937f9aee2d req-08ffbd30-864f-4e6a-baae-606c01c1886a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:06.182770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-0806fef5-d413-4f23-8ce5-cb937f9aee2d req-08ffbd30-864f-4e6a-baae-606c01c1886a service nova] Creating event network-vif-plugged:6323d0f2-9c69-4ebc-8c31-26281bc1b864 for instance 198b9d72-4d03-452a-9680-0724288c3351 on hv-cinder-85117 Jul 27 08:46:06.188535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-0806fef5-d413-4f23-8ce5-cb937f9aee2d req-08ffbd30-864f-4e6a-baae-606c01c1886a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Jul 27 08:46:06.189127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 327/664] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:06.298224 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:46:06.298759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:46:06.299232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:46:06.299635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:46:06.300067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:46:06.309076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:06.309641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:06.310537 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:06.310973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:06.328337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Getting quotas for project 5d10772d974f47d7bc82c0f0b8a8facf. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:46:06.332601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Getting quotas for user 7b63aaa3a9db4fa4b50bf93eae5a1ffc and project 5d10772d974f47d7bc82c0f0b8a8facf. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:46:06.337701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:06.338506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:06.345847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:06.346446 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:06.347340 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:06.347774 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:06.391779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:46:06.393773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='079997df-4eaa-40c2-8378-92b36f6938fc',volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:46:06.479932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:06.488034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b5620b29-c090-4668-8560-70e03a49023d tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.154860 Jul 27 08:46:06.488599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 328/665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:06 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:46:06.789106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4ab6fb70-78f8-4d7e-a699-de295ae463f9 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987103 Jul 27 08:46:06.789753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 338/666] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:46:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:46:06.801331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1d3ce11c-4e38-4ee4-abbd-fcf031663402 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:06.801961 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1d3ce11c-4e38-4ee4-abbd-fcf031663402 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:06.854731 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1d3ce11c-4e38-4ee4-abbd-fcf031663402 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:06.862465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1d3ce11c-4e38-4ee4-abbd-fcf031663402 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1088 microversion: 2.1 time: 0.065635 Jul 27 08:46:06.862950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 329/667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:06 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:07.508694 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:07.509307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:07.517294 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:07.517745 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:07.518547 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:07.519052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:07.651707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:07.659891 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2b62d1d4-a1da-4bfc-a2cd-6292f0ca1b15 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1363 microversion: 2.1 time: 0.155155 Jul 27 08:46:07.660462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 339/668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:07 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:07.882433 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:07.883040 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:07.889184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:07.889628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:07.890457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:07.891501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:07.950513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:07.959009 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3a427436-2695-4939-b1ba-d9733209a379 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1138 microversion: 2.1 time: 0.080519 Jul 27 08:46:07.959586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 330/669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:07 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:08.680882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:08.681517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:08.688283 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.688740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:08.689518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.690049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:08.824557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:08.832494 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8410d8b4-a067-4f11-8c3b-8cce48ca60e5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1548 microversion: 2.1 time: 0.156234 Jul 27 08:46:08.833055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 340/670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:08 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:08.853979 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:08.854950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:08.861082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.861533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:08.862325 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.862760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:08.957693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a08bf5ec-140e-4f5b-a188-5cfc1808debd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107893 Jul 27 08:46:08.958314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 331/671] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:46:08 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:08.980083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:08.980690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:08.986896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.987344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:08.988134 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:08.988567 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:09.050397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:09.058057 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b353c9e5-666f-435d-8179-973fce061ff1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1186 microversion: 2.1 time: 0.081831 Jul 27 08:46:09.058663 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 341/672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:08 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:10.080480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:10.081190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:10.087374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:10.087819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:10.088833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:10.089265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:10.154788 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:10.162293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6a045bd4-a734-4c8c-9eda-61aad9849cf1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1204 microversion: 2.1 time: 0.086860 Jul 27 08:46:10.162863 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 332/673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:10 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:10.617603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-c64fe852-de03-4922-aa70-cf7d6fbddc8d req-a885f650-93e8-4321-a307-ff3580543c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b9d72-4d03-452a-9680-0724288c3351", "tag": "6323d0f2-9c69-4ebc-8c31-26281bc1b864"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:10.629348 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-c64fe852-de03-4922-aa70-cf7d6fbddc8d req-a885f650-93e8-4321-a307-ff3580543c82 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:10.629803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-c64fe852-de03-4922-aa70-cf7d6fbddc8d req-a885f650-93e8-4321-a307-ff3580543c82 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:10.643153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-c64fe852-de03-4922-aa70-cf7d6fbddc8d req-a885f650-93e8-4321-a307-ff3580543c82 service nova] Creating event network-changed:6323d0f2-9c69-4ebc-8c31-26281bc1b864 for instance 198b9d72-4d03-452a-9680-0724288c3351 on hv-cinder-85117 Jul 27 08:46:10.649715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-c64fe852-de03-4922-aa70-cf7d6fbddc8d req-a885f650-93e8-4321-a307-ff3580543c82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036494 Jul 27 08:46:10.650844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 342/674] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:11.196306 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:11.199157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:11.210671 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:11.212284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:11.213971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:11.214673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:11.442229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:11.450181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c12c4c63-83bd-46fc-aaf4-774cc32cdaa5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.263843 Jul 27 08:46:11.450754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 333/675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:11 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:12.472932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:12.473640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:12.480345 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:12.480790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:12.481555 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:12.481980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:12.671139 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-406ed900-01bc-4acb-9851-dcc7318466d2 req-a4031e03-f230-44f5-a41c-0d0edbcb90ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:12.681709 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-406ed900-01bc-4acb-9851-dcc7318466d2 req-a4031e03-f230-44f5-a41c-0d0edbcb90ff service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:12.684301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-406ed900-01bc-4acb-9851-dcc7318466d2 req-a4031e03-f230-44f5-a41c-0d0edbcb90ff service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:12.694230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-406ed900-01bc-4acb-9851-dcc7318466d2 req-a4031e03-f230-44f5-a41c-0d0edbcb90ff service nova] Creating event network-changed:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:46:12.699360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-406ed900-01bc-4acb-9851-dcc7318466d2 req-a4031e03-f230-44f5-a41c-0d0edbcb90ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031907 Jul 27 08:46:12.699975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 334/676] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:46:12.839550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:12.847706 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-834ce2e5-08b7-4ba1-8ca8-c3edfc691f4f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.379621 Jul 27 08:46:12.848262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 343/677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:12 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:13.869252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:13.869944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:13.876622 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:13.877065 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:13.877838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:13.878298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:14.114576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:14.121900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-29a171fa-95bd-47cb-9658-2a4b9fefcff7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.257399 Jul 27 08:46:14.122690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 335/678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:13 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:15.142792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:15.143383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:15.145790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:15.150502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:15.150941 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:15.156557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:15.156557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:15.280793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:15.288746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2c64a677-2790-4a41-b85b-79b602e4850d tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.150003 Jul 27 08:46:15.289312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 344/679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:15 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:16.309882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:16.310517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:16.317097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:16.317544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:16.318349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:16.318787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:16.447587 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:16.455644 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-070a7a41-8069-44df-8e9e-5297e2d09c5c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.149839 Jul 27 08:46:16.456202 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 336/680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:16 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:17.476564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:17.477197 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:17.479499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:17.480275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:17.485834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:17.486327 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:17.487104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:17.487855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:17.621080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:17.628555 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-aa838898-bf7d-4e53-b8c1-166b59a2815b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.156245 Jul 27 08:46:17.629117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 345/681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:17 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:18.649451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:18.650058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:18.651998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:18.657311 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:18.657753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:18.658537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:18.658963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:18.790543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:18.798721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2a16bcf7-2418-4f41-bf79-95440e3cf6d3 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.153065 Jul 27 08:46:18.799296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 337/682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:18 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:19.819300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:19.819913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:19.826444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:19.826893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:19.827656 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:19.828795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:19.831652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=79 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:19.959970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:19.967548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-301bb3c4-32fd-49c1-b6de-724b469037f5 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.152180 Jul 27 08:46:19.968108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 346/683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:19 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:20.988730 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:20.989341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:20.995786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:20.996234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:20.996996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:20.997431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:21.124278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:21.132209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-08991e20-f78e-43c1-b922-8d7323988237 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.148030 Jul 27 08:46:21.132762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 338/684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:20 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:22.152855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:22.153453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:22.159898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:22.160346 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:22.161104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:22.161537 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:22.298716 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:22.306308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-76cb0369-fced-4bd2-8a27-3c68f1bdc573 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.157292 Jul 27 08:46:22.306906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 347/685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:22 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:23.329404 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:23.330005 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:23.336418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:23.336861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:23.337613 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:23.338045 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:23.467820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:23.475595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-50d9e659-c510-4882-95bd-71840e434b35 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.151636 Jul 27 08:46:23.476163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 339/686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:23 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:24.275813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-7db846f2-a00e-4cf9-95b3-ded34f152ad9 req-eb5a13cd-ee09-4fbb-8509-a41bb7522c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "name": "network-vif-plugged", "status": "completed", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:24.285893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-7db846f2-a00e-4cf9-95b3-ded34f152ad9 req-eb5a13cd-ee09-4fbb-8509-a41bb7522c9a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:24.286368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-7db846f2-a00e-4cf9-95b3-ded34f152ad9 req-eb5a13cd-ee09-4fbb-8509-a41bb7522c9a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:24.297646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-7db846f2-a00e-4cf9-95b3-ded34f152ad9 req-eb5a13cd-ee09-4fbb-8509-a41bb7522c9a service nova] Creating event network-vif-plugged:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:46:24.302573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-7db846f2-a00e-4cf9-95b3-ded34f152ad9 req-eb5a13cd-ee09-4fbb-8509-a41bb7522c9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Jul 27 08:46:24.303215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 348/687] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:24.495471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:24.496088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:24.503381 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:24.503833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:24.504658 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:24.505099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:24.643629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:24.651280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-cbfcf3aa-fd7d-46f0-acbd-a074437f1329 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.159944 Jul 27 08:46:24.651843 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 340/688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:24 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:25.673223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:25.673916 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:25.680190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:25.680633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:25.681381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:25.681811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:25.809192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:25.817301 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c69bc6bf-4e0a-4a94-b180-e38eda740741 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1260 microversion: 2.1 time: 0.148997 Jul 27 08:46:25.817865 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 349/689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:25 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:26.838017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:26.838907 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:26.846004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:26.846476 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:26.847230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:26.847662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:27.016121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:27.023786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a68e32bb-835d-4d4e-a6e5-acad96da87cd tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1445 microversion: 2.1 time: 0.189678 Jul 27 08:46:27.024360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 341/690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:26 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1445 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:27.044369 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:27.045004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:27.051606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:27.051899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:27.052668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:27.053152 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:27.184603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:27.192626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bc12b7f8-b053-4888-9d48-4609bd2aae48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1445 microversion: 2.1 time: 0.152102 Jul 27 08:46:27.193208 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 350/691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:27 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:29.400902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-81d0cb5a-745d-4088-81d1-6564846534e1 req-3d6575ac-5c1f-46fa-8842-9bc3735e8ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:29.406206 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=42 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:29.411515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-81d0cb5a-745d-4088-81d1-6564846534e1 req-3d6575ac-5c1f-46fa-8842-9bc3735e8ba8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:29.411964 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-81d0cb5a-745d-4088-81d1-6564846534e1 req-3d6575ac-5c1f-46fa-8842-9bc3735e8ba8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:29.424038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-81d0cb5a-745d-4088-81d1-6564846534e1 req-3d6575ac-5c1f-46fa-8842-9bc3735e8ba8 service nova] Creating event network-changed:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:46:29.429344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-81d0cb5a-745d-4088-81d1-6564846534e1 req-3d6575ac-5c1f-46fa-8842-9bc3735e8ba8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032136 Jul 27 08:46:29.429944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 342/692] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:32.044007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:32.044576 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:32.051718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:32.052167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:32.052931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:32.053368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:32.134421 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lazy-loading 'services' on Instance uuid 8f053d88-ea01-4efa-9bcc-0880e6194203 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:46:32.323645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-356aa0c0-6f12-4627-bac1-d3b75ab8a75d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments/21badbd2-32bb-4f61-84b8-6ec0b9ccc281" status: 202 len: 0 microversion: 2.1 time: 0.283320 Jul 27 08:46:32.324308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 351/693] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:46:32 2022] DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments/21badbd2-32bb-4f61-84b8-6ec0b9ccc281 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:46:32.335080 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:32.337927 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:32.345532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:32.345981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:32.346787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:32.347219 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:32.351047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:32.378014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7dcb32b7-9016-430e-b015-3db9bd8df413 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Jul 27 08:46:32.378606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 343/694] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:46:32 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:33.391138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:33.393366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:33.399632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:33.401458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:33.401458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:33.401458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:33.430563 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-aa732f08-fc16-4ae3-8202-ee1b3a960ffd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Jul 27 08:46:33.431454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 352/695] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:46:33 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:34.443296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:34.445448 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:34.452434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.452879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:34.454261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.454701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:34.483391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f5e4924c-7f3d-4dae-86a1-6c9e2e94f129 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044291 Jul 27 08:46:34.483933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 344/696] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:46:34 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:46:34.562998 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:34.563597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:34.570279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.570726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:34.571493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.571926 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:34.598266 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:46:34.929856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6d3d1ae3-4f24-42aa-98cf-17a84d93ce51 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 204 len: 0 microversion: 2.1 time: 0.370512 Jul 27 08:46:34.930510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 353/697] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:46:34 2022] DELETE /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:46:34.939154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:34.939803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:34.945957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.946437 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:34.947214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:34.947651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:35.081438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:35.089282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d6c73992-4ef2-4081-8839-5bfbed52dfde tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1689 microversion: 2.1 time: 0.154553 Jul 27 08:46:35.089854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 345/698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:34 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:36.111751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:36.112451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:36.119068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:36.119520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:36.120279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:36.120734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:36.248141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:36.255789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c60d5670-540f-47cd-b2ef-4488c05db006 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1689 microversion: 2.1 time: 0.149013 Jul 27 08:46:36.259061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 354/699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:36 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:37.276747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:37.277345 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:37.283922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:37.292500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:37.292500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:37.292500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:37.413123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:37.420533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-634ed952-869a-4941-a5f8-bc5b0ccf12f3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1689 microversion: 2.1 time: 0.147655 Jul 27 08:46:37.421086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 346/700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:37 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:38.442538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:38.443126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:38.449681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:38.450128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:38.450924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:38.451361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:38.583047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:38.590626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-749e4538-aa92-4caf-865c-13e21fd205a8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1689 microversion: 2.1 time: 0.152510 Jul 27 08:46:38.591180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 355/701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:38 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:39.613163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:39.613163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:39.619939 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:39.620685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:39.621196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:39.621631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:39.717645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:39.725833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fa6ab4eb-828f-475d-ba41-5530ee70e2b6 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1621 microversion: 2.1 time: 0.117787 Jul 27 08:46:39.726431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 347/702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:39 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1621 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:39.899715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-50f18b7f-3747-4805-a61d-885aa85db487 req-e53e225c-e250-43c1-be25-3c620be5368b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f053d88-ea01-4efa-9bcc-0880e6194203", "name": "network-vif-deleted", "tag": "6f674684-ef99-4489-89b2-62b7296f4a73"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:39.915904 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-50f18b7f-3747-4805-a61d-885aa85db487 req-e53e225c-e250-43c1-be25-3c620be5368b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:39.919422 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-50f18b7f-3747-4805-a61d-885aa85db487 req-e53e225c-e250-43c1-be25-3c620be5368b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:39.928179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-50f18b7f-3747-4805-a61d-885aa85db487 req-e53e225c-e250-43c1-be25-3c620be5368b service nova] Creating event network-vif-deleted:6f674684-ef99-4489-89b2-62b7296f4a73 for instance 8f053d88-ea01-4efa-9bcc-0880e6194203 on hv-cinder-85117 Jul 27 08:46:39.933209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-50f18b7f-3747-4805-a61d-885aa85db487 req-e53e225c-e250-43c1-be25-3c620be5368b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037552 Jul 27 08:46:39.933929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 356/703] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:40.747618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:40.748237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:40.755733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:40.756110 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:40.756889 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:40.757331 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:40.790229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:40.790793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:40.791142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lazy-loading 'fault' on Instance uuid 8f053d88-ea01-4efa-9bcc-0880e6194203 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:46:40.835367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:40.845357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-06cabedb-fc42-428c-8d96-b397df736a26 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 200 len: 1335 microversion: 2.1 time: 0.101162 Jul 27 08:46:40.846732 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 348/704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:40 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:41.867968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:41.868680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: 8f053d88-ea01-4efa-9bcc-0880e6194203] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:41.874785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:41.875275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:41.876902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:41.877414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:41.892613 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] HTTP exception thrown: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Request method failure captured: Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 HTTP/1.1 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Poed2m8e69flYFSd76bDHPzFAvbBDz0NIQR3bxJyeHiUTQgRCTQdAXpdTUjnKoFDkAxZcZu6KtweqBZXFLCVqFIB3aX8t6QKBeIJdbiN9TH1b85l_SdtoABrHNSrLo-vVUjPGn4ojSiltHh4kdxwRf4Nwzge37SZIWDqEmRqOTYGzs Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:46:41.894382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0d880114866423480268022d7dd20c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0d880114866423480268022d7dd20c5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 906ca078a25447b3b9c01f4fc76e7090 Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. Jul 27 08:46:41.895837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '8f053d88-ea01-4efa-9bcc-0880e6194203'} Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:46:41.896606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. Jul 27 08:46:41.898040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:41.899486 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Returning 404 to user: Instance 8f053d88-ea01-4efa-9bcc-0880e6194203 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:46:41.899486 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-132e870e-411b-4629-aeaa-55980cba69f8 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203" status: 404 len: 111 microversion: 2.1 time: 0.032480 Jul 27 08:46:41.899486 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 357/705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:41 2022] GET /compute/v2.1/servers/8f053d88-ea01-4efa-9bcc-0880e6194203 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:46:41.904563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1c82aaa3-2549-4fb8-8467-5c2c532999c3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '.version_select at 0x7f78f0ae0ca0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:41.991230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1c82aaa3-2549-4fb8-8467-5c2c532999c3 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309767652" status: 202 len: 0 microversion: 2.1 time: 0.090335 Jul 27 08:46:41.991966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 349/706] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Jul 27 08:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309767652 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:46:45.233324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:45.233792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:45.241284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:45.241728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:45.242512 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:45.242942 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:45.268564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:46:45.483587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:45.558509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a4eaa7d0-88d9-491a-b95f-569cb795f99d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 204 len: 0 microversion: 2.1 time: 0.328645 Jul 27 08:46:45.559121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 358/707] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:46:45 2022] DELETE /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:46:45.568454 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:45.569131 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:45.575840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:45.576298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:45.577089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:45.577529 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:45.706701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:45.714428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d2886ca6-00ca-415a-a270-467c66d8d7e5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1508 microversion: 2.1 time: 0.150886 Jul 27 08:46:45.714988 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 350/708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:45 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:46:46.735602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:46.736302 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:46.743240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:46.743691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:46.744444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:46.744882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:46.878410 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:46.885809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-16e434d7-6d27-41e3-8b23-e85d8559bdcd tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1508 microversion: 2.1 time: 0.154424 Jul 27 08:46:46.886402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 359/709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:46 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:47.908528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:47.908528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:47.915609 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:47.916062 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:47.917029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:47.917625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:47.953225 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-acb26880-3e73-435a-b0f7-55ce77ce1e06 req-9c8b34c4-b35e-443e-afaf-d6736727ddea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaa9a44-f92c-4932-bcfc-6f5195df3936", "name": "network-vif-deleted", "tag": "7704beb8-3578-4840-ad3c-229cb797c582"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:47.973572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-acb26880-3e73-435a-b0f7-55ce77ce1e06 req-9c8b34c4-b35e-443e-afaf-d6736727ddea service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:47.974517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-acb26880-3e73-435a-b0f7-55ce77ce1e06 req-9c8b34c4-b35e-443e-afaf-d6736727ddea service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:47.984057 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:47.987474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-acb26880-3e73-435a-b0f7-55ce77ce1e06 req-9c8b34c4-b35e-443e-afaf-d6736727ddea service nova] Creating event network-vif-deleted:7704beb8-3578-4840-ad3c-229cb797c582 for instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 on hv-cinder-85117 Jul 27 08:46:47.992517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-acb26880-3e73-435a-b0f7-55ce77ce1e06 req-9c8b34c4-b35e-443e-afaf-d6736727ddea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045035 Jul 27 08:46:47.993126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 360/710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:47.993541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5ee88581-c233-44ea-bd65-d2c7ff6b58d7 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 200 len: 1466 microversion: 2.1 time: 0.090340 Jul 27 08:46:47.994498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 351/711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:47 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 1466 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:49.015999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:49.016813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: dcaa9a44-f92c-4932-bcfc-6f5195df3936] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:49.023048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.023497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.024360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.024799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.039590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] HTTP exception thrown: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Request method failure captured: Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 HTTP/1.1 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Poed2m8e69flYFSd76bDHPzFAvbBDz0NIQR3bxJyeHiUTQgRCTQdAXpdTUjnKoFDkAxZcZu6KtweqBZXFLCVqFIB3aX8t6QKBeIJdbiN9TH1b85l_SdtoABrHNSrLo-vVUjPGn4ojSiltHh4kdxwRf4Nwzge37SZIWDqEmRqOTYGzs Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:46:49.044380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0d880114866423480268022d7dd20c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0d880114866423480268022d7dd20c5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 906ca078a25447b3b9c01f4fc76e7090 Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. Jul 27 08:46:49.045792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'dcaa9a44-f92c-4932-bcfc-6f5195df3936'} Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:46:49.046731 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. Jul 27 08:46:49.048557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:46:49.049599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Returning 404 to user: Instance dcaa9a44-f92c-4932-bcfc-6f5195df3936 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:46:49.049599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4eb481f6-7bb0-4ec7-aaca-7a96286d428e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936" status: 404 len: 111 microversion: 2.1 time: 0.031311 Jul 27 08:46:49.049599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 361/712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:49 2022] GET /compute/v2.1/servers/dcaa9a44-f92c-4932-bcfc-6f5195df3936 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:46:49.052064 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:49.052557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:49.059319 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.059869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.061644 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.062082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.088166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:46:49.324668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a2f420cb-7fe4-4812-ad38-98c707cecf6e tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 204 len: 0 microversion: 2.1 time: 0.276948 Jul 27 08:46:49.325262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 352/713] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:46:49 2022] DELETE /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:46:49.333925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:49.334590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:49.340739 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.341179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.342002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:49.342451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:49.345605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:46:49.473438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:49.481400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bda90af8-b162-4999-9e12-e88e20f96af5 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.151354 Jul 27 08:46:49.481960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 362/714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:49 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:46:50.502649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:50.503702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:50.509932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:50.510412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:50.511182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:50.511616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:50.641276 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:50.648883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-30eeaac9-3d76-4088-adee-f60a287501b9 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.150667 Jul 27 08:46:50.649439 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 353/715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:50 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:51.670769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:51.671407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:51.678269 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:51.678718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:51.679476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:51.679907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:51.815631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:51.823026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0613dc5b-3c30-447d-970d-f563672ab67d tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1521 microversion: 2.1 time: 0.156048 Jul 27 08:46:51.823532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 363/716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:51 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:46:52.819626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-3668f2ac-66b2-4816-bc86-746dae05b1fe req-c3fd1ed3-0c02-454d-b1a0-3c0c7c72af2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac824ac8-4d92-4c41-8a17-c96d40d2ce05", "name": "network-vif-deleted", "tag": "75614ea5-42c0-4439-8250-f07133e78608"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:46:52.829561 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-3668f2ac-66b2-4816-bc86-746dae05b1fe req-c3fd1ed3-0c02-454d-b1a0-3c0c7c72af2b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:52.829995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-3668f2ac-66b2-4816-bc86-746dae05b1fe req-c3fd1ed3-0c02-454d-b1a0-3c0c7c72af2b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:52.844122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-3668f2ac-66b2-4816-bc86-746dae05b1fe req-c3fd1ed3-0c02-454d-b1a0-3c0c7c72af2b service nova] Creating event network-vif-deleted:75614ea5-42c0-4439-8250-f07133e78608 for instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 on hv-cinder-85117 Jul 27 08:46:52.844875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:52.845480 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:52.849579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-3668f2ac-66b2-4816-bc86-746dae05b1fe req-c3fd1ed3-0c02-454d-b1a0-3c0c7c72af2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Jul 27 08:46:52.850174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 354/717] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:46:52.852791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:52.853237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:52.853999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:52.854453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:52.919872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ca078a25447b3b9c01f4fc76e7090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d880114866423480268022d7dd20c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:46:52.927952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-241143a1-734a-4bad-9f59-4ab6fd533a8b tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 200 len: 1479 microversion: 2.1 time: 0.086856 Jul 27 08:46:52.928518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 364/718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:52 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:46:53.948897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:46:53.949635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] [instance: ac824ac8-4d92-4c41-8a17-c96d40d2ce05] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:46:53.956671 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:53.957124 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:53.957896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:46:53.958366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:46:53.973614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] HTTP exception thrown: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Request method failure captured: Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 HTTP/1.1 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4Poed2m8e69flYFSd76bDHPzFAvbBDz0NIQR3bxJyeHiUTQgRCTQdAXpdTUjnKoFDkAxZcZu6KtweqBZXFLCVqFIB3aX8t6QKBeIJdbiN9TH1b85l_SdtoABrHNSrLo-vVUjPGn4ojSiltHh4kdxwRf4Nwzge37SZIWDqEmRqOTYGzs Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:46:53.975438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0d880114866423480268022d7dd20c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0d880114866423480268022d7dd20c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0d880114866423480268022d7dd20c5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: a0d880114866423480268022d7dd20c5 Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944421603 Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 906ca078a25447b3b9c01f4fc76e7090 Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944421603-project Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. Jul 27 08:46:53.976751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'ac824ac8-4d92-4c41-8a17-c96d40d2ce05'} Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:46:53.977493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. Jul 27 08:46:53.978683 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:46:53.979712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] Returning 404 to user: Instance ac824ac8-4d92-4c41-8a17-c96d40d2ce05 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:46:53.979712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8fdbc7ca-2b5c-4480-8ab5-f29368f04cf4 tempest-ServerRescueNegativeTestJSON-944421603 tempest-ServerRescueNegativeTestJSON-944421603-project] 10.222.0.40 "GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05" status: 404 len: 111 microversion: 2.1 time: 0.032364 Jul 27 08:46:53.979712 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 355/719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:46:53 2022] GET /compute/v2.1/servers/ac824ac8-4d92-4c41-8a17-c96d40d2ce05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:47:01.146404 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:01.147084 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:01.153151 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:01.153592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:01.154405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:01.154832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:01.177908 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-15537b84-d681-4196-90d9-743c8d1d5fa0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/ips" status: 200 len: 149 microversion: 2.1 time: 0.036005 Jul 27 08:47:01.178531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 365/720] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:47:01 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:03.828549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b36b9066-c66c-4820-90c1-0a0f81392f09"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:03.830876 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:03.836937 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:03.837904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:03.838390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:03.839432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:03.839869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:04.519246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:04.668075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9e3404e9-2080-480d-9a73-b7563061557d tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843256 Jul 27 08:47:04.668826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 356/721] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:47:03 2022] POST /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:06.058807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:06.059351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:06.065769 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:06.066258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:06.067024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:06.067481 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:06.089863 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-91817a08-8675-474a-8707-bea26eed9658 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/ips" status: 200 len: 151 microversion: 2.20 time: 0.034726 Jul 27 08:47:06.090462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 366/722] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Jul 27 08:47:06 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:47:11.345777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:11.346436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:11.353392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:11.353845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:11.354642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:11.355077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:11.378043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lazy-loading 'flavor' on Instance uuid e039946f-9689-47a3-85ab-cdd76c8ab6be {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:47:11.851001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-54278aee-2d2b-4421-bff6-9b3a64efa02d tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/action" status: 202 len: 0 microversion: 2.20 time: 0.509834 Jul 27 08:47:11.851684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 357/723] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Jul 27 08:47:11 2022] POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:47:11.859914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:11.860519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:11.867796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:11.868275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:11.869023 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:11.869452 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:12.001597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:12.010123 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:12.014680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:12.014680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5e4ca529-7f0c-43f6-b16f-c97671b4aaf3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.156969 Jul 27 08:47:12.014680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 367/724] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:11 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:13.037779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:13.038510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:13.045569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:13.046047 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:13.046968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:13.047299 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:13.176713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:13.184640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:13.186174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:13.187353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-81bda5fa-89f1-47d2-84e4-7377a09e6b00 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.154979 Jul 27 08:47:13.187900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 358/725] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:13 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:14.209029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:14.209799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:14.216490 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:14.216931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:14.217689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:14.218121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:14.356083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:14.364068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:14.366185 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:14.367431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ba967649-3d4c-4840-8e73-2aa96d803a15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.162282 Jul 27 08:47:14.367992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 368/726] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:14 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:15.390317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:15.390931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:15.398230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:15.398725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:15.399455 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:15.399918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:15.535511 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:15.544137 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:15.545817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:15.547013 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a4e2a456-6fa2-4751-9b6a-3b582b5d2f09 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.160602 Jul 27 08:47:15.547576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 359/727] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:15 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:16.571296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:16.571686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:16.578053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:16.578534 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:16.579307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:16.579773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:16.713767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:16.722333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:16.723835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:16.735212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6448cdc1-af44-4cf3-b562-b1f99cf4ad02 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.158297 Jul 27 08:47:16.735212 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 369/728] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:16 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:17.628722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b36b9066-c66c-4820-90c1-0a0f81392f09"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:17.631361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:17.637896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.638390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.639265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.639713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.718522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: POST /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments HTTP/1.1 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 74 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:47:17.720226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {"volumeAttachment": {"volumeId": "b36b9066-c66c-4820-90c1-0a0f81392f09"}} Jul 27 08:47:17.721822 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'server_id': '159ef74b-f7ad-4522-a24f-174383d37309', 'body': {'volumeAttachment': {'volumeId': 'b36b9066-c66c-4820-90c1-0a0f81392f09'}}} Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:17.727081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:17.728564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 400 to user: Invalid volume: volume b36b9066-c66c-4820-90c1-0a0f81392f09 is already attached to instances: 159ef74b-f7ad-4522-a24f-174383d37309 {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b9122cc0-e509-4420-912d-029e11bfd2cb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097048 Jul 27 08:47:17.730075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 360/729] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:47:17 2022] POST /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:47:17.761100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:17.761860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:17.764119 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:17.769264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.774758 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.775724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.776179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.789399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:17.789892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:17.795901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.796350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.797113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:17.797551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:17.886277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'services' on Instance uuid 159ef74b-f7ad-4522-a24f-174383d37309 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:47:17.914266 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:17.926592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:17.928139 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:17.929498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-21cf8332-0a6a-4b0f-b918-9f755d988175 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.176413 Jul 27 08:47:17.944917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 370/730] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:17 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:18.155247 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-593f8b3a-28e9-44e9-b4aa-c7728fd4d625 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments/b36b9066-c66c-4820-90c1-0a0f81392f09" status: 202 len: 0 microversion: 2.1 time: 0.370163 Jul 27 08:47:18.155829 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 361/731] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:47:17 2022] DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments/b36b9066-c66c-4820-90c1-0a0f81392f09 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:47:18.173051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:18.175470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:18.181365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:18.181874 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:18.182885 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:18.183372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:18.213580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e8fdeae9-18f7-4e3c-aaf6-0f7e5dfc694e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Jul 27 08:47:18.214132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 371/732] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:47:18 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:18.953234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:18.953949 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:18.961048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:18.961493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:18.962419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:18.962858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:19.110000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:19.120188 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:19.121625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:19.122806 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f3eacf3e-ab68-4be4-a3da-a9ba81ce920e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.174103 Jul 27 08:47:19.123352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 362/733] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:18 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:19.226933 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:19.229088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:19.235557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:19.236004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:19.236764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:19.237195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:19.267524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e69f9067-67a0-4af4-83fb-14e77e044858 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Jul 27 08:47:19.268270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 372/734] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:47:19 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:20.146033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:20.147030 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:20.153402 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.153852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.154901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.155339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.281708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:20.284913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:20.285238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:20.292963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.293410 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.294045 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:20.294409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.294836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.295797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:20.297174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f472ac21-072a-4c56-9176-c05071473230 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.155203 Jul 27 08:47:20.298184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 363/735] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:20 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:20.329174 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e401c121-037b-4cb8-83d3-ba0b4942a166 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052500 Jul 27 08:47:20.329728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 373/736] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:47:20 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:47:20.394811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:20.395307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:20.401547 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.401996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.402813 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.403247 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.429208 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:47:20.721366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-15a382bb-2b30-4a77-938d-e5dceea8e59e tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 204 len: 0 microversion: 2.1 time: 0.330069 Jul 27 08:47:20.721955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 364/737] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:47:20 2022] DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:47:20.732561 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:20.733156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:20.739319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.739761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.740516 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:20.740947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:20.875983 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:20.884310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0ab53d38-c8b6-4d16-b416-3835c5226fb5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1681 microversion: 2.1 time: 0.154665 Jul 27 08:47:20.884310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 374/738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:20 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:21.322789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:21.323479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:21.330150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:21.330614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:21.331378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:21.331830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:21.465777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:21.473700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:21.475338 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:21.476478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-aa380a74-6db8-4771-808e-06c0f72c90c9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.159286 Jul 27 08:47:21.477028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 365/739] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:21 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:21.904862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:21.905464 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:21.912640 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:21.913078 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:21.913855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:21.914312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:21.916796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=74 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:22.045927 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:22.054314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-29d8494d-bd14-4cf3-8a7d-90382f6c3824 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1681 microversion: 2.1 time: 0.153380 Jul 27 08:47:22.055113 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 375/740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:21 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:22.500230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:22.500777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:22.508119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:22.508562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:22.509329 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:22.509761 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:22.647465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:22.655524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:22.657211 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:22.658440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2a1d33da-d230-4657-be82-30dba54aeac9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.162264 Jul 27 08:47:22.659019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 366/741] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:22 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:23.076167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:23.076764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:23.083182 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:23.083623 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:23.085064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:23.085502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:23.222761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:23.230386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2ffb4a08-006d-426e-89a3-410685b1f496 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1681 microversion: 2.1 time: 0.158064 Jul 27 08:47:23.230940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 376/742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:23 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:23.682385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:23.683173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:23.689745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:23.690368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:23.691142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:23.691578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:23.862506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:23.870571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:23.872076 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:23.873241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-282103f7-dd89-4bae-9de5-c4623f59178c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.194910 Jul 27 08:47:23.873874 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 367/743] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:23 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:24.183007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-9ce73eef-ab2e-4ecf-94c0-d0724923858a req-86f71944-0c9a-446e-8ba8-561fecd5d3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159ef74b-f7ad-4522-a24f-174383d37309", "name": "network-vif-deleted", "tag": "59ab739b-608a-4deb-9d9c-07a3e116ee2e"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:24.192906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9ce73eef-ab2e-4ecf-94c0-d0724923858a req-86f71944-0c9a-446e-8ba8-561fecd5d3ad service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:24.194336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9ce73eef-ab2e-4ecf-94c0-d0724923858a req-86f71944-0c9a-446e-8ba8-561fecd5d3ad service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:24.206818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-9ce73eef-ab2e-4ecf-94c0-d0724923858a req-86f71944-0c9a-446e-8ba8-561fecd5d3ad service nova] Creating event network-vif-deleted:59ab739b-608a-4deb-9d9c-07a3e116ee2e for instance 159ef74b-f7ad-4522-a24f-174383d37309 on hv-cinder-85117 Jul 27 08:47:24.212978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-9ce73eef-ab2e-4ecf-94c0-d0724923858a req-86f71944-0c9a-446e-8ba8-561fecd5d3ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035059 Jul 27 08:47:24.214231 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 377/744] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:24.252615 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:24.253239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:24.264839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:24.265571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:24.266392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:24.266830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:24.306465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:24.354119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:24.362612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1cc05e6c-0f07-4641-9738-7b69a4abdebb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 200 len: 1613 microversion: 2.1 time: 0.113824 Jul 27 08:47:24.363182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 368/745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:24 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:24.898637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:24.899422 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:24.905801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:24.906379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:24.907239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:24.907783 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:25.063145 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:25.072413 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:25.074291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:25.075696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ff692c57-b9a8-4df0-b2f8-f1eea94afe70 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.182753 Jul 27 08:47:25.076747 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 378/746] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:24 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:25.386236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:25.386842 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:25.393565 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:25.394007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:25.394792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:25.395229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:25.408528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 HTTP/1.1 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:47:25.410214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:47:25.411571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '159ef74b-f7ad-4522-a24f-174383d37309'} Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:47:25.412715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:47:25.414172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:47:25.415839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:47:25.415839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ef95accc-35d4-4b4f-870e-17b1e8795768 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 404 len: 111 microversion: 2.1 time: 0.029514 Jul 27 08:47:25.415839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 369/747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:25 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:47:25.420662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c41d469f-a943-4daf-ad18-db5a117d96b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '.version_select at 0x7f78f0b1bdc0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:25.533290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c41d469f-a943-4daf-ad18-db5a117d96b0 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927699050" status: 202 len: 0 microversion: 2.1 time: 0.116373 Jul 27 08:47:25.533887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 379/748] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Jul 27 08:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927699050 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:47:26.100348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:26.100987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:26.107651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:26.108093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:26.108855 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:26.109285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:26.255524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:26.264528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:26.266023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:26.267326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-998ae637-4813-4917-aa5a-3a039088b409 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.171889 Jul 27 08:47:26.268022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 370/749] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:26 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:26.303715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2f2df58a-0a78-4c33-a688-1c6de21f6b6b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: .version_select at 0x7f78f0c38820>, body: {"keypair": {"name": "tempest-keypair-1011499174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOygv1ivrcuo4qFnIJh0SSkolQx2L3aYcI89VIFNuN+Ptp9IXgjtmk9ZuvDLmJEyVRe/u4KOAHHrq2IKuUebQG5cOp2kC7NiYmuUU04ekLewwydF2u5jSKkkPoilOLYCFg=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:26.320045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-2f2df58a-0a78-4c33-a688-1c6de21f6b6b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:47:26.323847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-2f2df58a-0a78-4c33-a688-1c6de21f6b6b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:47:26.417251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2f2df58a-0a78-4c33-a688-1c6de21f6b6b tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117738 Jul 27 08:47:26.417847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 380/750] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:47:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:27.291631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:27.292239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:27.298341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:27.298812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:27.299558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:27.299995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:27.452237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:27.460790 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:27.462365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:27.463511 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d4ac8274-a451-47f5-a23e-7a07e5bbbfac tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.176839 Jul 27 08:47:27.464239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 371/751] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:27 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:28.488515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:28.489126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:28.496721 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:28.497197 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:28.497985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:28.498446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:28.640267 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:28.649929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:28.652121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:28.653517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9c1c5597-a16b-4b5b-9860-7f857757c433 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1742 microversion: 2.20 time: 0.169802 Jul 27 08:47:28.654239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 381/752] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:28 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:28.726336 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-831224989", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f6980da-175b-4e92-9032-637e0458eb4f"}], "security_groups": [{"name": "tempest-securitygroup--1612667255"}], "key_name": "tempest-keypair-1011499174", "user_data": "}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:28.831956 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] validate_networks() for [('8f6980da-175b-4e92-9032-637e0458eb4f', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:47:29.202521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:47:29.202996 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:47:29.203518 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:47:29.203933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:47:29.204348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:47:29.214294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:29.215016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:29.215820 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:29.216302 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:29.233804 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:47:29.237739 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Getting quotas for user c370dd8fa3aa407ca22cce8425fcbc25 and project 940250de2f6f47ed9edc1bb0468551c8. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:47:29.249212 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:47:29.251532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:47:29.368278 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9502f8f3-368c-4c1f-ac61-fa0cb7aaf186 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647290 Jul 27 08:47:29.368919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 372/753] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:47:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:47:29.379821 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-820d1f4f-be91-403b-ac18-ceccb8a49e04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:29.381114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-820d1f4f-be91-403b-ac18-ceccb8a49e04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:29.433094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-820d1f4f-be91-403b-ac18-ceccb8a49e04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:29.439781 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-820d1f4f-be91-403b-ac18-ceccb8a49e04 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1241 microversion: 2.1 time: 0.063992 Jul 27 08:47:29.440347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 382/754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:29 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:29.676885 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:29.677988 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:29.685276 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:29.685721 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:29.686517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:29.686947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:29.817134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:29.825942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:29.827575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:29.828723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6e8e54ed-0d9f-48b3-9ca8-93aabb0b4151 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1742 microversion: 2.20 time: 0.155845 Jul 27 08:47:29.829288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 373/755] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:29 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:30.461620 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:30.462257 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:30.469075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:30.469528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:30.470466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:30.470837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:30.537980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:30.547659 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2e69ee86-bd85-4286-aad2-9e80744e7536 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1245 microversion: 2.1 time: 0.090566 Jul 27 08:47:30.548550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 383/756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:30 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:30.852427 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:30.853043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:30.859673 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:30.860127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:30.860915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:30.861399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:31.051032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:31.070398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:31.070398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:31.070398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-376cd330-cd38-441b-a8d5-986e0fefe1c3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1742 microversion: 2.20 time: 0.213613 Jul 27 08:47:31.070722 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 374/757] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:30 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:31.569540 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:31.570227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:31.577378 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:31.577937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:31.579006 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:31.579443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:31.675164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:31.675164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-72794d28-0e9d-4db6-b562-3cbf7dfa1a8a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1301 microversion: 2.1 time: 0.088732 Jul 27 08:47:31.675164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 384/758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:31 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:32.091584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:32.092601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:32.104909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:32.112303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:32.112303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:32.112303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:32.292314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:32.300509 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:32.302091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:32.304268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fff0531d-b281-4309-aafb-90712bf394e8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1742 microversion: 2.20 time: 0.221167 Jul 27 08:47:32.305048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 375/759] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:32 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:32.687603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:32.688210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:32.695267 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:32.695721 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:32.696700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:32.697141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:32.798946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-a93436c0-0b94-4f24-b5d6-f0d54e5a2e98 req-f6918164-f636-466f-a080-3cae9d2b88ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "name": "network-vif-plugged", "status": "completed", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:32.810808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-a93436c0-0b94-4f24-b5d6-f0d54e5a2e98 req-f6918164-f636-466f-a080-3cae9d2b88ca service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:32.811649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-a93436c0-0b94-4f24-b5d6-f0d54e5a2e98 req-f6918164-f636-466f-a080-3cae9d2b88ca service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:32.824357 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-a93436c0-0b94-4f24-b5d6-f0d54e5a2e98 req-f6918164-f636-466f-a080-3cae9d2b88ca service nova] Creating event network-vif-plugged:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:47:32.832701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-a93436c0-0b94-4f24-b5d6-f0d54e5a2e98 req-f6918164-f636-466f-a080-3cae9d2b88ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040886 Jul 27 08:47:32.834222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 376/760] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:32.871429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:32.880674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e8c06485-98fa-47d4-8657-cceba4003980 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.196797 Jul 27 08:47:32.881639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 385/761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:32 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:33.328917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:33.329626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:33.336550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:33.338003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:33.338003 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:33.338363 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:33.446879 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-63fae35c-ac7e-4e97-a194-b3d05119e248 req-f058b2e9-e165-4108-8018-7d7d379513cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8bed67-af36-4697-a38a-a67f2023ddd4", "tag": "431e23f4-5504-40f2-986d-b204f33f480c"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:33.461176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-63fae35c-ac7e-4e97-a194-b3d05119e248 req-f058b2e9-e165-4108-8018-7d7d379513cb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:33.461931 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-63fae35c-ac7e-4e97-a194-b3d05119e248 req-f058b2e9-e165-4108-8018-7d7d379513cb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:33.481837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-63fae35c-ac7e-4e97-a194-b3d05119e248 req-f058b2e9-e165-4108-8018-7d7d379513cb service nova] Creating event network-changed:431e23f4-5504-40f2-986d-b204f33f480c for instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 on hv-cinder-85117 Jul 27 08:47:33.488245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-63fae35c-ac7e-4e97-a194-b3d05119e248 req-f058b2e9-e165-4108-8018-7d7d379513cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046639 Jul 27 08:47:33.489242 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 386/762] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:33.591252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:33.602046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:33.611406 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:33.613456 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3a3c9012-7ce0-4591-aba8-315c54fe4327 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1742 microversion: 2.20 time: 0.289661 Jul 27 08:47:33.614050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 377/763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:33 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1742 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:33.907857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:33.909198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:33.916010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:33.916465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:33.917242 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:33.917676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:34.053528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:34.061677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c7104d9f-42b6-4a4d-9c36-b43c1ed438b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.157933 Jul 27 08:47:34.063681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 387/764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:33 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:34.637710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:34.637710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:34.640134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:34.645199 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:34.645654 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:34.647317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:34.648123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:34.785213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:34.789072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:34.790619 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:34.791743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7e650e07-5fd6-4fe9-b97b-0fe937621f1f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.158513 Jul 27 08:47:34.792295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 378/765] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:34 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:35.096538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:35.097190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:35.104148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:35.104594 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:35.105394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:35.105873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:35.245099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:35.245099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d1fd25f4-4fde-4c5e-9ab3-11199e29b25a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.151302 Jul 27 08:47:35.245099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 388/766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:35 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:35.815121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:35.815735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:35.823915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:35.823915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:35.823915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:35.824253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:35.954995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:35.963466 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:35.965210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:35.966386 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6ed74c4c-ea9b-45b9-bd21-13a1330f5845 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.155608 Jul 27 08:47:35.966933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 379/767] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:35 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:36.265207 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:36.265903 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:36.272548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:36.272969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:36.273747 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:36.274227 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:36.433476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:36.440884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d4d39d5d-c861-4619-b79a-55ae4fdb44c6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.179630 Jul 27 08:47:36.441446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 389/768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:36 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:36.989474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:36.990725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:36.997528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:36.997977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:36.998766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:36.999281 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:37.140416 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:37.149418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:37.152239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:37.152239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-924cdf94-70fb-4a6d-9771-a0a0d49124d9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.166971 Jul 27 08:47:37.152900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 380/769] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:36 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:37.461412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:37.461967 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:37.469128 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:37.469898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:37.470764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:37.471742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:37.622522 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:37.630263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-313a848b-40fc-46d7-9d53-147ab0257026 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.172485 Jul 27 08:47:37.651004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 390/770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:37 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:38.175976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:38.176590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:38.184664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:38.188754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:38.188754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:38.188754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:38.352196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:38.361134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:38.362699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:38.364164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-15fee742-3c13-4646-9e9c-144e17686bcf tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.192123 Jul 27 08:47:38.365576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 381/771] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:38 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:38.653574 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:38.655094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:38.666823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:38.668340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:38.670049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:38.670488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:39.119069 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:39.126544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bd2f9e28-912b-46db-bc16-ab34ef5d6eee tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.477196 Jul 27 08:47:39.127353 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 391/772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:38 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:39.390848 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:39.392207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:39.395044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:39.395758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:39.402375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:39.403144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:39.403981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:39.404589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:39.581112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:39.592227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:39.594704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:39.596971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ac67961a-9ffa-4987-acf5-e532e9b76af3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.211343 Jul 27 08:47:39.598111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 382/773] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:39 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:40.148138 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:40.149420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:40.155490 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:40.157861 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.158411 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.159412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.159930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.332151 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:40.344974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ea9c563b-3de2-40d2-8f17-cc1b6fe20fa8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.199942 Jul 27 08:47:40.346201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 392/774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:40 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:40.440165 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:40.441337 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:40.451383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.454908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.454908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.454908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.481951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6f1952fe-c78e-4daa-aa55-79e53b8f8904 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/ips" status: 200 len: 144 microversion: 2.1 time: 0.046167 Jul 27 08:47:40.492028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 383/775] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:47:40 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/ips => generated 144 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:40.622300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:40.623061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:40.633527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.634107 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.635262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:40.635704 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:40.782671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:40.791349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:40.792852 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:40.794166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2849240-eae3-40e8-9d54-e5e01353e46c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.176068 Jul 27 08:47:40.795028 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 393/776] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:40 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:41.371553 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:41.372117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:41.379327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:41.383284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:41.383284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:41.383284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:41.408968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-a15408f4-1223-49a4-8344-3be9c020cfc3 req-08e1ce64-b7bf-47e9-a0dd-18163e682d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8bed67-af36-4697-a38a-a67f2023ddd4", "name": "network-vif-plugged", "status": "completed", "tag": "431e23f4-5504-40f2-986d-b204f33f480c"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:41.455616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a15408f4-1223-49a4-8344-3be9c020cfc3 req-08e1ce64-b7bf-47e9-a0dd-18163e682d83 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:41.456054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a15408f4-1223-49a4-8344-3be9c020cfc3 req-08e1ce64-b7bf-47e9-a0dd-18163e682d83 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:41.492094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-a15408f4-1223-49a4-8344-3be9c020cfc3 req-08e1ce64-b7bf-47e9-a0dd-18163e682d83 service nova] Creating event network-vif-plugged:431e23f4-5504-40f2-986d-b204f33f480c for instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 on hv-cinder-85117 Jul 27 08:47:41.500077 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-a15408f4-1223-49a4-8344-3be9c020cfc3 req-08e1ce64-b7bf-47e9-a0dd-18163e682d83 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094340 Jul 27 08:47:41.506248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 394/777] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:47:41.562746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:41.574555 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-de43923a-c4a9-41ee-8d48-6fc47a448265 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.209971 Jul 27 08:47:41.575651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 384/778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:41 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:41.817663 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:41.819116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:41.825826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:41.826498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:41.827459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:41.828055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:42.007493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:42.016566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:42.018081 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:42.021253 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c92863ad-da50-43b9-bab9-a38b6c56a833 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.207977 Jul 27 08:47:42.031143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 395/779] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:41 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:42.598301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:42.599977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:42.607159 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:42.607855 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:42.608888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:42.609548 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:42.760480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:42.770055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c936c53a-7863-4e64-8b85-5455f32e12b6 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.175865 Jul 27 08:47:42.776083 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 385/780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:42 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:42.856823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1106719009", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "networks": [{"uuid": "9bba3fa4-5e04-4bc1-9606-6e36bde604cc"}]}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:42.914725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] validate_networks() for [('9bba3fa4-5e04-4bc1-9606-6e36bde604cc', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:47:43.044802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:43.045430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:43.052925 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.053960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.054256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.054693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.220781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:43.231936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:43.233724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:43.235111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7312caba-0095-4f93-b397-e9b3496c2f15 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.194288 Jul 27 08:47:43.250824 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 386/781] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:43 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:47:43.314581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:47:43.314916 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:47:43.315581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:47:43.315985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:47:43.316387 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:47:43.325852 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.326348 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.327153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.327587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.346062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Getting quotas for project 1e1afe245d7045de99b1c9a2d13f2822. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:47:43.350612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Getting quotas for user ebb7349917df46f7a2b2d98a47b91c1f and project 1e1afe245d7045de99b1c9a2d13f2822. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:47:43.362577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:47:43.365543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:47:43.640319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-be84e675-b01a-492b-95a6-db0df7b40fea tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787412 Jul 27 08:47:43.652902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-66dcaf4c-ce67-4be7-a223-0189333c19e9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:43.653515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-66dcaf4c-ce67-4be7-a223-0189333c19e9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:43.658610 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 396/782] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:47:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:47:43.714747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-66dcaf4c-ce67-4be7-a223-0189333c19e9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:43.724711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:43.734241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:43.735437 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-66dcaf4c-ce67-4be7-a223-0189333c19e9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1214 microversion: 2.1 time: 0.085425 Jul 27 08:47:43.750637 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 387/783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:43 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:43.758753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.763030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.763030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.763030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.777244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:43.792534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:43.793166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:43.799901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.800559 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.801546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:43.802734 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:43.843913 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:43.981356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:44.006478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-77f539a0-5c12-48fc-b8ed-b942eaa2d54a tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1367 microversion: 2.1 time: 0.214179 Jul 27 08:47:44.014280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 388/784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:43 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:47:44.260000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:44.260687 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:44.269233 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:44.270521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:44.273168 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:44.273676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:44.485984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:44.498504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:44.500393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:44.501625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-099792ff-6b73-4bfe-af91-3f134bb38e98 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.246156 Jul 27 08:47:44.502459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 389/785] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:44 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:44.761252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d288a7a4-08a4-4157-92fd-2d01def3420b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:44.762106 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d288a7a4-08a4-4157-92fd-2d01def3420b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:44.826891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d288a7a4-08a4-4157-92fd-2d01def3420b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:44.834126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d288a7a4-08a4-4157-92fd-2d01def3420b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1214 microversion: 2.1 time: 0.078958 Jul 27 08:47:44.834700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 390/786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:44 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:47:45.028236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:45.028845 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:45.036270 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.036759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.037630 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.038163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.172661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:45.180129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-494f4612-2043-4c03-ac46-ca22ddba8a83 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1557 microversion: 2.1 time: 0.155892 Jul 27 08:47:45.180789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 391/787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:45 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:47:45.195544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-84edd197-9a16-443b-89dd-3e81923b3ecd tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.475378 Jul 27 08:47:45.196226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 397/788] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:47:43 2022] POST /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 194 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:47:45.203495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:45.203862 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:45.211169 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.211827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.212877 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.213319 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.292753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-027cae0b-db8a-40f4-b7c7-57ed18277713 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093861 Jul 27 08:47:45.301827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 392/789] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Jul 27 08:47:45 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:45.529575 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:45.530498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:45.547217 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.554244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.554244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.554244 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.794070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:45.807492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:45.810032 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:45.813896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d7661e38-d43a-42dc-8135-67e1c19b88d0 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.291333 Jul 27 08:47:45.816899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 398/790] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:45 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:45.856514 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:45.857882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:45.868458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.870333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.871317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:45.873107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:45.990701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:46.000018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-846e960f-9329-4914-a56a-364ece7216c5 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1210 microversion: 2.1 time: 0.147434 Jul 27 08:47:46.001178 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 393/791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:45 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:46.783553 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-bcf11e5a-5ca1-4331-9505-e0b0236a322b req-a5320663-488f-458a-81b7-e4cab562d78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8bed67-af36-4697-a38a-a67f2023ddd4", "tag": "431e23f4-5504-40f2-986d-b204f33f480c"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:46.794558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-bcf11e5a-5ca1-4331-9505-e0b0236a322b req-a5320663-488f-458a-81b7-e4cab562d78e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:46.794999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-bcf11e5a-5ca1-4331-9505-e0b0236a322b req-a5320663-488f-458a-81b7-e4cab562d78e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:46.809226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-bcf11e5a-5ca1-4331-9505-e0b0236a322b req-a5320663-488f-458a-81b7-e4cab562d78e service nova] Creating event network-changed:431e23f4-5504-40f2-986d-b204f33f480c for instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 on hv-cinder-85117 Jul 27 08:47:46.817780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-bcf11e5a-5ca1-4331-9505-e0b0236a322b req-a5320663-488f-458a-81b7-e4cab562d78e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038120 Jul 27 08:47:46.818416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 399/792] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:46.843155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:46.843792 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:46.853702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:46.854174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:46.854968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:46.855400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:47.023430 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:47.024517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:47.036071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:47.036860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:47.039037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:47.046628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:47.140727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:47.151280 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c6ad6dfc-8718-4f74-8624-f0ec1d60b7c0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1266 microversion: 2.1 time: 0.132719 Jul 27 08:47:47.152425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 400/793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:47 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:47:47.262209 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:47.274111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:47.278566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:47.278566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a33d8249-de5c-430e-b946-7b6b6f65be0a tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.438143 Jul 27 08:47:47.278566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 394/794] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:46 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:47:48.177871 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:48.179342 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:48.205741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:48.221057 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:48.224266 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:48.225634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:48.227299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:48.302160 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:48.303580 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:48.321254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:48.322096 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:48.323225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:48.326731 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:48.552079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:48.561934 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:48.566174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:48.567487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-415acc30-31ea-4732-89e2-2fd9fc0f9cab tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.270245 Jul 27 08:47:48.568344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 395/795] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:48 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:48.884038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:48.891484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0ccb9b92-d135-4304-8e50-de274df3dc7b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.718397 Jul 27 08:47:48.892057 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 401/796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:48 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:49.596968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:49.597502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:49.605858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:49.606359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:49.607932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:49.608793 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:49.802632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:49.812773 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:49.814950 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:49.818023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-43b753a3-f6d4-44ce-82d2-d16b4813b81e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.225249 Jul 27 08:47:49.819297 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 396/797] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:49 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:49.914654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:49.915887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:49.923378 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:49.924216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:49.925795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:49.926260 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:50.103730 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:50.109679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-85ad78ea-242d-4498-8bea-208726ec0ca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.199726 Jul 27 08:47:50.110276 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 402/798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:49 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:50.212588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-6def1e67-0787-40ed-ac03-24970f8759b4 req-d2fc3013-c597-4b06-9a46-df4584a5735e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dccdbf2-7b0b-4e02-8986-272a2d692e99", "tag": "5593fd40-b18b-4285-984c-ca9ee6a84c55"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:50.234558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6def1e67-0787-40ed-ac03-24970f8759b4 req-d2fc3013-c597-4b06-9a46-df4584a5735e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:50.235314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6def1e67-0787-40ed-ac03-24970f8759b4 req-d2fc3013-c597-4b06-9a46-df4584a5735e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:50.252741 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-6def1e67-0787-40ed-ac03-24970f8759b4 req-d2fc3013-c597-4b06-9a46-df4584a5735e service nova] Creating event network-changed:5593fd40-b18b-4285-984c-ca9ee6a84c55 for instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 on hv-cinder-85117 Jul 27 08:47:50.279808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-6def1e67-0787-40ed-ac03-24970f8759b4 req-d2fc3013-c597-4b06-9a46-df4584a5735e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073776 Jul 27 08:47:50.280414 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 397/799] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:50.847439 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:50.848044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:50.854169 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:50.854625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:50.855371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:50.855796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:51.047689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:51.056428 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:51.057925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:51.059133 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-322d5a5f-2238-49ac-bb9c-2c7eacf5fbd7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1737 microversion: 2.20 time: 0.215439 Jul 27 08:47:51.059683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 403/800] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:50 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:51.133989 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:51.134744 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:51.140974 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:51.141430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:51.142232 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:51.142677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:51.280670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:51.288636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e39f0bf6-405f-4c31-af33-2cfc9f06b5d9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.159560 Jul 27 08:47:51.289201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 398/801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:51 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:52.082046 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:52.082864 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:52.089808 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:52.090532 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:52.091282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:52.091709 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:52.220785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:52.229278 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:52.230785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:52.231915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-485f9343-7bc9-4b50-8086-b8fbd86fe09f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1719 microversion: 2.20 time: 0.153863 Jul 27 08:47:52.232467 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 404/802] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:52 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:52.309344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:52.309946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:52.316494 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:52.316947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:52.317732 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:52.318181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:52.449443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:52.456821 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f9a65c23-62a7-4494-a7c4-6270dd101718 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.151498 Jul 27 08:47:52.457374 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 399/803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:52 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:53.255015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:53.255621 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:53.262210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:53.262665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:53.263427 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:53.263860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:53.337669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:53.358299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=6 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:53.392608 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:53.401026 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:53.402548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:53.403692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b56e3123-b4fd-450f-82dc-30be8af7bae9 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1719 microversion: 2.20 time: 0.152636 Jul 27 08:47:53.404245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 405/804] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:53 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:53.478644 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:53.479258 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:53.485759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:53.486240 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:53.487002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:53.487440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:53.613123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:53.621148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fb5978d8-7cc7-42ea-98d0-43b9071740fe tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.146497 Jul 27 08:47:53.621699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 400/805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:53 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:54.426395 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:54.427011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:54.433609 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:54.434059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:54.434853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:54.435288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:54.563135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:54.571365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:54.572892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:54.574101 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-28bfa520-3b85-4ab8-add4-9f61c86ce5a2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1719 microversion: 2.20 time: 0.151605 Jul 27 08:47:54.574703 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 406/806] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:54 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:54.642607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:54.643235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:54.650931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:54.651371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:54.652140 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:54.652570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:54.792691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:54.800398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3ec0d73d-97fe-4a9a-830a-6ff8a3945cf9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.161720 Jul 27 08:47:54.801189 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 401/807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:54 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:55.057258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:55.059398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-4cd84db9-b0c1-49b4-b159-f2863ba66057 req-d12a8477-672d-467c-8efc-f8aa72b688c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "name": "network-vif-unplugged", "status": "completed", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:55.059807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:55.064699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=4 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:55.067166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.067750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.069012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.069676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.070564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4cd84db9-b0c1-49b4-b159-f2863ba66057 req-d12a8477-672d-467c-8efc-f8aa72b688c1 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.071072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4cd84db9-b0c1-49b4-b159-f2863ba66057 req-d12a8477-672d-467c-8efc-f8aa72b688c1 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.083825 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-4cd84db9-b0c1-49b4-b159-f2863ba66057 req-d12a8477-672d-467c-8efc-f8aa72b688c1 service nova] Creating event network-vif-unplugged:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:47:55.089635 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-4cd84db9-b0c1-49b4-b159-f2863ba66057 req-d12a8477-672d-467c-8efc-f8aa72b688c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034425 Jul 27 08:47:55.090515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 402/808] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:47:55.104188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-10f61dfb-e606-490b-96e3-7c23334acc1c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051901 Jul 27 08:47:55.104751 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 407/809] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:47:55 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:55.116313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:55.119579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:55.123326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.123769 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.124575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.125022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.154763 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4d9db761-4ee5-4e62-a95c-eae600695f95 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d" status: 200 len: 194 microversion: 2.1 time: 0.042625 Jul 27 08:47:55.155396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 403/810] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Jul 27 08:47:55 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:55.597035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:55.597668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:55.604484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.604926 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.605689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.606116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.740445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:55.749215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:55.750800 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:55.751943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-55429323-99e2-4525-bd09-8bcf43cd1efc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1719 microversion: 2.20 time: 0.158778 Jul 27 08:47:55.752500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 408/811] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:55 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:55.821324 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:55.821936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:55.828413 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.828865 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.829626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:55.830107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:55.958410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:55.966755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-85b00bad-d6dc-4901-a260-0cabaef60b2e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.149742 Jul 27 08:47:55.968462 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 404/812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:55 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:56.705027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5db7119-19fb-4744-8cf7-6432518bf56e"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:56.707601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:56.715822 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.716770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:56.717761 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.718332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:56.777478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:56.777478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:56.781010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.781398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:56.782185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.782620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:56.916393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:56.924298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:56.925789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:56.926987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1cc5b12f-2bb0-4ab2-a477-509211de616c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1719 microversion: 2.20 time: 0.156721 Jul 27 08:47:56.927538 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 405/813] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:56 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:47:56.989160 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:56.990423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:56.997605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.998052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:56.999114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:56.999549 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:57.135805 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:57.143296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-55a4cba1-0eb8-4dc8-bb0f-3af5807762b2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.158956 Jul 27 08:47:57.143854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 406/814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:56 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:47:57.171962 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-ddf9663f-5e29-4748-b27d-83f4f0003f41 req-24b71158-1e47-4dae-a2ef-b3c956e87d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dccdbf2-7b0b-4e02-8986-272a2d692e99", "name": "network-vif-plugged", "status": "completed", "tag": "5593fd40-b18b-4285-984c-ca9ee6a84c55"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:57.181538 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-ddf9663f-5e29-4748-b27d-83f4f0003f41 req-24b71158-1e47-4dae-a2ef-b3c956e87d00 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:57.181980 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-ddf9663f-5e29-4748-b27d-83f4f0003f41 req-24b71158-1e47-4dae-a2ef-b3c956e87d00 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:57.192817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-ddf9663f-5e29-4748-b27d-83f4f0003f41 req-24b71158-1e47-4dae-a2ef-b3c956e87d00 service nova] Creating event network-vif-plugged:5593fd40-b18b-4285-984c-ca9ee6a84c55 for instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 on hv-cinder-85117 Jul 27 08:47:57.198445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-ddf9663f-5e29-4748-b27d-83f4f0003f41 req-24b71158-1e47-4dae-a2ef-b3c956e87d00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 Jul 27 08:47:57.199033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 407/815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:47:57.616347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e3210609-0592-41b6-876f-a09393809b3c tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "POST /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915112 Jul 27 08:47:57.617112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 409/816] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:47:56 2022] POST /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:47:57.950550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:57.951247 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:57.957813 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:57.958300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:57.959068 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:57.959504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:57.977831 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=100 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:58.089039 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:58.097067 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:58.098590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:58.099759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-268f6bd4-30de-434f-86d2-57ad6cab3773 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1662 microversion: 2.20 time: 0.153508 Jul 27 08:47:58.100287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 408/817] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:47:57 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:47:58.123166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd70c3e-2a63-4178-9d5a-b091421f3a1b"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:47:58.125651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:58.131897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:58.132290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:58.133683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:58.134126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:58.163699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:58.168072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:58.170826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:58.171277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:58.172044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:58.172478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:58.307400 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:58.319663 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1c4c9013-eb87-48be-a79e-e54dad7a7018 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.159433 Jul 27 08:47:58.321221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 409/818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:58 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:47:58.691149 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:47:59.152319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-30ac79da-5b0a-4425-aabb-2e299859493e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.034475 Jul 27 08:47:59.152988 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 410/819] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Jul 27 08:47:58 2022] POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments => generated 188 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 08:47:59.276589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:59.277120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:59.283568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:59.284010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:59.284762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:59.285191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:59.342683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:47:59.343419 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:47:59.349653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:59.350199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:59.350965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:47:59.351398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:47:59.488609 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:47:59.496832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b4bb6c8e-4fdb-4aa2-843a-2bed88542568 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1314 microversion: 2.1 time: 0.158451 Jul 27 08:47:59.497388 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 411/820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:47:59 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:00.051706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e2789a2f-1f9b-4b80-b62b-d67397b5c190 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments/bbd70c3e-2a63-4178-9d5a-b091421f3a1b" status: 202 len: 0 microversion: 2.20 time: 0.778886 Jul 27 08:48:00.052239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 410/821] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Jul 27 08:47:59 2022] DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments/bbd70c3e-2a63-4178-9d5a-b091421f3a1b => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:48:00.112614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:00.113177 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:00.119403 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.119857 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.120627 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.121065 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.358900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-509e3aeb-90a1-4d0d-9601-3acb4fe0e721 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/action" status: 202 len: 0 microversion: 2.20 time: 0.250276 Jul 27 08:48:00.359557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 412/822] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Jul 27 08:48:00 2022] POST /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:48:00.368333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:00.369073 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:00.376252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.376705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.377473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.377911 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.510899 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:00.517878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:00.518509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:00.528091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:00.529589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:00.530737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-47630055-941a-4f9c-9451-800d639195b8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1670 microversion: 2.20 time: 0.166934 Jul 27 08:48:00.531292 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 411/823] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:00 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:00.546382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.546961 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.547817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:00.548805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:00.681892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:00.689287 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e0f085b9-7110-4668-882c-b4fabf000e94 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1499 microversion: 2.1 time: 0.175196 Jul 27 08:48:00.689855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 413/824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:00 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:01.553620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:01.554252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:01.560810 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:01.561294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:01.562053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:01.562541 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:01.663850 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:01.664722 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:01.671915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:01.672510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:01.673292 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:01.673778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:01.703599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:48:01.859213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:01.867172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:01.868838 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:01.870002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-50e721fb-1e6e-4025-83a8-bce06cb60dc1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1670 microversion: 2.20 time: 0.320277 Jul 27 08:48:01.870624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 412/825] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:01 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:01.998116 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-075c00df-fe87-40c8-9b29-f9a55efbfa5b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 204 len: 0 microversion: 2.1 time: 0.338028 Jul 27 08:48:01.999029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 414/826] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:48:01 2022] DELETE /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 08:48:02.007153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:02.007928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:02.013857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:02.014335 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:02.015123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:02.015556 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:02.158678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:02.166963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0421be26-6679-4573-861f-4bf3d5ffac22 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1505 microversion: 2.1 time: 0.163605 Jul 27 08:48:02.167515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 413/827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:02 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:02.893763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:02.894498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:02.900971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:02.901417 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:02.902192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:02.902626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:03.041370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:03.041370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:03.042895 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:03.044030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-59364f0e-0f35-4224-9137-05270cd932f7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1672 microversion: 2.20 time: 0.154573 Jul 27 08:48:03.044592 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 415/828] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:02 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:03.188669 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:03.189268 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:03.196055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:03.196518 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:03.197326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:03.197776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:03.330698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:03.339083 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a26beae3-f94b-4eea-8136-fbd697490557 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1505 microversion: 2.1 time: 0.154352 Jul 27 08:48:03.339653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 414/829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:03 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:04.067402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:04.068005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:04.075287 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:04.076487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:04.076487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:04.076929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:04.341815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:04.349763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:04.351311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:04.352694 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1d864cb0-ef87-401e-b03a-cd75d68d5f23 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.289204 Jul 27 08:48:04.354632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 416/830] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:04 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:04.361059 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:04.361799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:04.373191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:04.373883 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:04.374713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:04.375169 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:04.511438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:04.532226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2e814a73-328d-4476-a52d-808d5b7a46ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1505 microversion: 2.1 time: 0.163520 Jul 27 08:48:04.532919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 415/831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:04 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:04.726520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-21cc5072-9d16-40f5-bf55-0b7b63103169 req-eb55bf49-8116-45fe-bf49-34a78e6606db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dccdbf2-7b0b-4e02-8986-272a2d692e99", "name": "network-vif-deleted", "tag": "5593fd40-b18b-4285-984c-ca9ee6a84c55"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:04.736061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-21cc5072-9d16-40f5-bf55-0b7b63103169 req-eb55bf49-8116-45fe-bf49-34a78e6606db service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:04.736505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-21cc5072-9d16-40f5-bf55-0b7b63103169 req-eb55bf49-8116-45fe-bf49-34a78e6606db service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:04.747214 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-21cc5072-9d16-40f5-bf55-0b7b63103169 req-eb55bf49-8116-45fe-bf49-34a78e6606db service nova] Creating event network-vif-deleted:5593fd40-b18b-4285-984c-ca9ee6a84c55 for instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 on hv-cinder-85117 Jul 27 08:48:04.751902 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-21cc5072-9d16-40f5-bf55-0b7b63103169 req-eb55bf49-8116-45fe-bf49-34a78e6606db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029190 Jul 27 08:48:04.752525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 417/832] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:05.376617 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:05.377351 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:05.386998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:05.390239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:05.390239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:05.390239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:05.546477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:05.550603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:05.564595 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:05.565054 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:05.565838 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:05.566467 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:05.598075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:05.606832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:05.607465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:05.608037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lazy-loading 'fault' on Instance uuid 7dccdbf2-7b0b-4e02-8986-272a2d692e99 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:05.608287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:05.610007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:05.611365 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-78960dc8-3853-407c-8259-fd11f55cfff1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.238889 Jul 27 08:48:05.616489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 416/833] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:05 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:05.654419 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:05.666673 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-af04262d-94b2-4f06-b3ef-987c30bd698f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 200 len: 1304 microversion: 2.1 time: 0.124621 Jul 27 08:48:05.668431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 418/834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:05 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:06.198235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:06.200544 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:06.203700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=82 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:06.207288 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.207746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.208535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.208978 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.242166 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-60d8b808-0895-4115-aa6e-1d2a9f3c8e36 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047793 Jul 27 08:48:06.248246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 417/835] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:48:06 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:06.379813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:06.380588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:06.388955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.389086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.389829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.390290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.423846 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d8e3484a-ba9c-47e7-b157-637b39dc36b5 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d" status: 200 len: 194 microversion: 2.1 time: 0.047867 Jul 27 08:48:06.424433 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 419/836] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Jul 27 08:48:06 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:06.435294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:06.435819 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:06.442380 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.442837 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.443603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.444066 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.526852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lazy-loading 'services' on Instance uuid 198b9d72-4d03-452a-9680-0724288c3351 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:06.634997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:06.636267 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:06.643470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.644213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.645228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.645911 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.729500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f0423064-ba70-478c-8346-f9d34c83bffe tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d" status: 202 len: 0 microversion: 2.1 time: 0.298153 Jul 27 08:48:06.730036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 418/837] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:48:06 2022] DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/585ff0d8-f8b2-4c2d-8ba8-e19c59f4013d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:48:06.741075 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:06.744012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 7dccdbf2-7b0b-4e02-8986-272a2d692e99] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:06.752880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.753516 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.754481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:06.755068 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:06.776650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] HTTP exception thrown: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Request method failure captured: Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 HTTP/1.1 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PurSxZNNgpxAeTlFeQWMDGga24Pn6uSZ1jQwuZKZw_ZoJ0JpApEnxZ_KdPE8_1hR0De_Bwh4W9QT0UqMwscV5HF8OpXrcZHfavH6ya2WeItmIJCBjlJ6A_Q2RfOqa-gbTX6pkW1T3hqt0JbFjh48SPb8EvuvKjkioQL0dk8c_z14zI Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 1e1afe245d7045de99b1c9a2d13f2822 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesActionsTest-703864075 Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:48:06.779050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e1afe245d7045de99b1c9a2d13f2822", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesActionsTest-703864075 Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 1e1afe245d7045de99b1c9a2d13f2822 Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesActionsTest-703864075 Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesActionsTest-703864075-project Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: ebb7349917df46f7a2b2d98a47b91c1f Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesActionsTest-703864075-project Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. Jul 27 08:48:06.780410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '7dccdbf2-7b0b-4e02-8986-272a2d692e99'} Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:06.781207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. Jul 27 08:48:06.782631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:06.784532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Returning 404 to user: Instance 7dccdbf2-7b0b-4e02-8986-272a2d692e99 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:06.785716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5c5188c3-dff5-4a39-8cca-b2e8cc099b28 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99" status: 404 len: 111 microversion: 2.1 time: 0.053988 Jul 27 08:48:06.786551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 419/838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:06 2022] GET /compute/v2.1/servers/7dccdbf2-7b0b-4e02-8986-272a2d692e99 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:06.856795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:06.869343 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:06.870273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-133562756", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "networks": [{"uuid": "9bba3fa4-5e04-4bc1-9606-6e36bde604cc"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:06.871856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:06.873779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d7e268a6-c4c2-431b-b2c4-a1fa1ae77da3 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.243393 Jul 27 08:48:06.874746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 420/839] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:06 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:06.937738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] validate_networks() for [('9bba3fa4-5e04-4bc1-9606-6e36bde604cc', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:48:07.378290 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:48:07.379675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:48:07.380534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:48:07.381243 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:48:07.381943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:48:07.392627 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:07.393157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:07.394027 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:07.394568 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:07.413586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Getting quotas for project 1e1afe245d7045de99b1c9a2d13f2822. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:48:07.418787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Getting quotas for user ebb7349917df46f7a2b2d98a47b91c1f and project 1e1afe245d7045de99b1c9a2d13f2822. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:48:07.432872 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:48:07.435291 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:48:07.537654 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a52cd4d0-b4ec-41bb-870f-e6746b97811a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671620 Jul 27 08:48:07.538366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 420/840] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 08:48:07.549349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a9ab063c-56f3-45e3-8bd9-3a3441265b23 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:07.549950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a9ab063c-56f3-45e3-8bd9-3a3441265b23 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:07.609412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a9ab063c-56f3-45e3-8bd9-3a3441265b23 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:07.615887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a9ab063c-56f3-45e3-8bd9-3a3441265b23 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1213 microversion: 2.1 time: 0.070540 Jul 27 08:48:07.616488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 421/841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:07 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:07.902629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:07.903531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:07.914865 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:07.915327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:07.916113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:07.916557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:08.061489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:08.070938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:08.072467 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:08.073879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-da2d33eb-46b7-4e75-a90d-02236e5f2b8f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.176911 Jul 27 08:48:08.074463 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 421/842] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:07 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:08.637180 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:08.637924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:08.646839 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:08.647459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:08.648475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:08.649268 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:08.718975 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:08.726791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f1259412-c69a-4b65-b222-1acab0cc8c88 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.094666 Jul 27 08:48:08.727330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 422/843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:08 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:09.097257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:09.098027 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:09.104914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:09.105363 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:09.106129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:09.106595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:09.236144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:09.246198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:09.248038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:09.249345 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1f3060ae-b3d6-4dcc-b258-434135871c1e tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.156062 Jul 27 08:48:09.249905 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 422/844] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:09 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:09.747615 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:09.748207 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:09.757360 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:09.758806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:09.760241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:09.760989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:09.824666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:09.832308 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6335f6d7-078c-4c2a-b3f3-7f88b32d8815 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.088536 Jul 27 08:48:09.832878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 423/845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:09 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:10.273025 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:10.274613 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:10.289567 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:10.290051 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:10.290836 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:10.291269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:10.309755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:10.433479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:10.441385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:10.442904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:10.444052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-12914e15-70ca-402f-95c7-92d3544a9d58 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.175073 Jul 27 08:48:10.444605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 423/846] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:10 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:10.855415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:10.856017 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:10.863297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:10.863742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:10.864585 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:10.865071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:11.105500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:11.112458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:11.129598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c4755360-28f7-40a7-8fe9-143f419ce06b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.264906 Jul 27 08:48:11.129598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 424/847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:10 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:11.469652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:11.470947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:11.478959 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:11.479412 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:11.480198 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:11.480637 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:11.635520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:11.644457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:11.657350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:11.657350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4c042513-1de5-48c2-a815-4bca95be1480 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.182254 Jul 27 08:48:11.657350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 424/848] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:11 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:12.139774 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:12.140372 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:12.147103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:12.147541 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:12.148289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:12.153168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:12.221432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:12.231087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-972d23de-9d32-4509-a652-75bdd36644cd tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.095300 Jul 27 08:48:12.242602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 425/849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:12 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:12.673692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:12.674540 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:12.685887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:12.686489 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:12.687390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:12.687893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:12.827239 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:12.835105 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:12.837708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:12.838887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e84007f1-fb5a-4a8e-a504-303572154185 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.171162 Jul 27 08:48:12.839438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 425/850] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:12 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:13.264433 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:13.264433 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:13.269725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:13.270187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:13.270950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:13.271383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:13.336336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:13.343997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2bbedb2b-2d46-471f-808e-f3e7c9a6dca2 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.086507 Jul 27 08:48:13.344559 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 426/851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:13 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:13.863285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:13.864113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:13.871183 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:13.871623 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:13.872396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:13.872829 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:14.003776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:14.012298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:14.014089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:14.015588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d72589b2-6641-4594-92c8-31afce9f3d36 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.157344 Jul 27 08:48:14.016376 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 426/852] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:13 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:14.365604 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:14.366218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:14.373231 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:14.373672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:14.374492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:14.376759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:14.440147 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:14.448394 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b5025b19-e38d-4507-9345-dc8c5d3fe2a0 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.087196 Jul 27 08:48:14.448956 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 427/853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:14 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:15.042538 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:15.043145 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:15.049805 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:15.050294 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:15.051063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:15.051502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:15.218382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:15.225888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:15.227429 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:15.228742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-18222b96-e787-423f-a78f-84ec5b733559 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.190742 Jul 27 08:48:15.229296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 427/854] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:15 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:15.469460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:15.470097 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:15.476773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:15.477213 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:15.478601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:15.479036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:15.544013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:15.554754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fdfa5e90-98e1-47ba-bf46-9367dbccd407 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.089262 Jul 27 08:48:15.561114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 428/855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:15 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:16.252082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:16.252803 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:16.260015 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:16.270651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:16.270651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:16.270651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:16.392678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:16.404336 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:16.489554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:16.489554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a8a49658-13cc-4184-907c-aa35a170b5dc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.160361 Jul 27 08:48:16.489554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 428/856] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:16 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:16.577642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:16.578298 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:16.584896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:16.585548 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:16.586337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:16.586766 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:16.648151 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:16.657773 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2f823025-593a-450a-961b-38ae5fd30c62 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.084080 Jul 27 08:48:16.658459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 429/857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:16 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:17.432367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:17.433007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:17.435394 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:17.436153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:17.440957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:17.441434 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:17.442216 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:17.442696 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:17.580808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:17.589364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:17.594650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:17.594650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b4991549-7ce8-49c6-86df-da072527b531 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.164753 Jul 27 08:48:17.594650 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 429/858] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:17 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:17.678923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:17.684529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:17.684529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:17.687349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:17.687791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:17.688543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:17.688970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:17.753844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:17.761705 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e68d3037-5361-400d-839f-d0a22bafe245 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.086587 Jul 27 08:48:17.762281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 430/859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:17 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:18.616783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:18.617467 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:18.624012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:18.624545 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:18.625307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:18.625738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:18.757935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:18.766097 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:18.767612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:18.768758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a3e724d4-54b2-42c9-97d8-e33fe31e80c5 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.156185 Jul 27 08:48:18.769297 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 430/860] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:18 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:18.782589 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:18.783194 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:18.785430 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:18.791086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:18.791544 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:18.792336 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:18.792835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:18.852033 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:18.860405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-530ad6a6-2b5b-47d3-854c-f51dbd23f811 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.082032 Jul 27 08:48:18.860958 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 431/861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:18 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:19.792888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:19.793435 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:19.799942 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:19.800391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:19.801148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:19.801581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:19.882107 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:19.882833 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:19.890317 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:19.890768 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:19.891538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:19.891974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:19.933459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:19.941457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:19.943012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:19.944176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1920b02e-2250-47da-bfb1-f7e6a9764643 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.155367 Jul 27 08:48:19.944740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 431/862] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:19 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:19.952166 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:19.959477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d163dc41-1dc7-4446-8957-7995191d9876 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.081355 Jul 27 08:48:19.960025 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 432/863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:19 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:20.972436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:20.973028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:20.979157 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:20.979645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:20.979758 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:20.980011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:20.980779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:20.981210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:20.986203 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:20.986654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:20.987417 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:20.987835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:21.050328 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:21.057721 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ee9d3d6b-7772-4da5-aeef-f681f2405731 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1217 microversion: 2.1 time: 0.082426 Jul 27 08:48:21.058311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 433/864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:20 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:21.114554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:21.122436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:21.123916 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:21.125063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6fb89d0c-072d-4801-af57-43d4802112ee tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.156537 Jul 27 08:48:21.125614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 432/865] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:20 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:22.079075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:22.080020 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:22.085818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:22.086299 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:22.087626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:22.088067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:22.149332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:22.149958 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:22.157825 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:22.159566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:22.160159 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:22.160960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:22.161396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:22.168059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b545da4f-f027-4eef-88f4-ef0996fd57fa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1209 microversion: 2.1 time: 0.093191 Jul 27 08:48:22.168883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 434/866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:22 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:22.327786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:22.327786 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:22.328095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:22.328095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b04230e5-fc1b-407f-a8d5-935924804f96 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.163322 Jul 27 08:48:22.328095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 433/867] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:22 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:23.193022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:23.203398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:23.203398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.203398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.203398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.203923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.267086 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:23.274661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c70fb0ad-aa66-4f0d-9458-e0a32e463e9b tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1273 microversion: 2.1 time: 0.085321 Jul 27 08:48:23.275431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 435/868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:23 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:23.349014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:23.349672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:23.357355 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.357808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.358743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.359182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.518222 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:23.527298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:23.528832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:23.534044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2611595f-ef4c-4c5c-98d3-fca2a264121c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.184996 Jul 27 08:48:23.534044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 434/869] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:23 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:23.914226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:23.918179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:23.920725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.921165 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.921932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.922373 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.953924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f7eb4fa8-4386-42a1-a2d6-361aad911028 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/d5db7119-19fb-4744-8cf7-6432518bf56e" status: 200 len: 194 microversion: 2.1 time: 0.043667 Jul 27 08:48:23.954557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 436/870] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Jul 27 08:48:23 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/d5db7119-19fb-4744-8cf7-6432518bf56e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:23.966118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:23.975689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:23.975689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.975689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:23.975689 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:23.976181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:24.058701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lazy-loading 'services' on Instance uuid 198b9d72-4d03-452a-9680-0724288c3351 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:24.228276 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-49d5a133-9a83-4d8e-b804-77758095b666 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/d5db7119-19fb-4744-8cf7-6432518bf56e" status: 202 len: 0 microversion: 2.1 time: 0.266820 Jul 27 08:48:24.229063 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 435/871] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:48:23 2022] DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments/d5db7119-19fb-4744-8cf7-6432518bf56e => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:48:24.297353 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:24.298648 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:24.306209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:24.306817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:24.307805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:24.308223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:24.443279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:24.451600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e5790111-ffbb-40a5-9ea7-cd5f82e81af6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.158547 Jul 27 08:48:24.452251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 437/872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:24 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:24.554246 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:24.555074 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:24.561901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:24.562581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:24.563485 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:24.563998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:24.757296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:24.766221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:24.767746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:24.768904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-507bda17-6807-4ddd-9fb9-972ff1260d1b tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.219690 Jul 27 08:48:24.769461 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 436/873] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:24 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:25.011031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-3b847870-3626-4051-a741-af8e5c39ce8c req-0fdbb046-633a-4a42-9974-d223f3304f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39de4969-6044-4fa4-b9d1-fe0d5d59da0d", "tag": "c867b62f-3e3b-47c7-a632-b1d7198b0f7b"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:25.024650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-3b847870-3626-4051-a741-af8e5c39ce8c req-0fdbb046-633a-4a42-9974-d223f3304f36 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.024650 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-3b847870-3626-4051-a741-af8e5c39ce8c req-0fdbb046-633a-4a42-9974-d223f3304f36 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.037103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-3b847870-3626-4051-a741-af8e5c39ce8c req-0fdbb046-633a-4a42-9974-d223f3304f36 service nova] Creating event network-changed:c867b62f-3e3b-47c7-a632-b1d7198b0f7b for instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d on hv-cinder-85117 Jul 27 08:48:25.042092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-3b847870-3626-4051-a741-af8e5c39ce8c req-0fdbb046-633a-4a42-9974-d223f3304f36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jul 27 08:48:25.043087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 438/874] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:48:25.206182 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-6f6cd2d2-51c2-4e2c-b879-2e9a74a91c3e req-88ae8f3f-5516-4098-a62c-86165e9b1009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "name": "network-vif-plugged", "status": "completed", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:25.217954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6f6cd2d2-51c2-4e2c-b879-2e9a74a91c3e req-88ae8f3f-5516-4098-a62c-86165e9b1009 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.218691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6f6cd2d2-51c2-4e2c-b879-2e9a74a91c3e req-88ae8f3f-5516-4098-a62c-86165e9b1009 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.230551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-6f6cd2d2-51c2-4e2c-b879-2e9a74a91c3e req-88ae8f3f-5516-4098-a62c-86165e9b1009 service nova] Creating event network-vif-plugged:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:48:25.235491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-6f6cd2d2-51c2-4e2c-b879-2e9a74a91c3e req-88ae8f3f-5516-4098-a62c-86165e9b1009 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Jul 27 08:48:25.236093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 437/875] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:25.417282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.419647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.426401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.426854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.427661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.428099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.458605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-887175ab-5202-4365-9e74-23107d804220 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046222 Jul 27 08:48:25.459163 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 439/876] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:48:25 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:48:25.473879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.474575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.485682 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.486135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.486936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.487546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.593708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.595991 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.602275 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.602744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.604168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.604684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.634914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e1f233d4-fed4-4119-bacc-50832e8a2f56 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045544 Jul 27 08:48:25.635799 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 440/877] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:48:25 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:48:25.703634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.704131 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.710636 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.711098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.711867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.712300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.720643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:25.728163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0d9dd74f-a78b-4a1c-bf8c-6854f887f03e tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.258789 Jul 27 08:48:25.730038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 438/878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:25 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:25.746045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:48:25.760238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=100 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:25.792808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.793426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.799624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.800077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.800850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.801379 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.932177 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:25.940150 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:25.948428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:25.948428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ae2bfc01-e8ab-4735-92c1-cd9f86426225 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.155005 Jul 27 08:48:25.948428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 439/879] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:25 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:25.977303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d41150ec-77f5-4960-8b98-06d160491403 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 204 len: 0 microversion: 2.1 time: 0.277348 Jul 27 08:48:25.977907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 441/880] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:48:25 2022] DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 08:48:25.986309 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:25.986909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:25.992775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.993221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.994012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:25.994672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:25.997366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:26.168807 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:26.176344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6f6557f8-41be-4dd1-a898-809913057df4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.193636 Jul 27 08:48:26.176921 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 440/881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:25 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:26.751501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:26.752192 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:26.758616 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:26.759062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:26.760518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:26.760946 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:26.885520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:26.892813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-cbf834ca-9229-4db3-b1f6-8b1f628846ab tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.145494 Jul 27 08:48:26.893367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 442/882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:26 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:26.964676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:26.965285 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:26.972048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:26.972498 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:26.973265 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:26.973702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:27.099291 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:27.107751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:27.109255 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:27.110433 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c4004ed2-4412-4ed1-a76a-eec95148ea2f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.149623 Jul 27 08:48:27.110984 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 441/883] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:26 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:27.197779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:27.198403 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:27.204572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:27.205028 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:27.205830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:27.206300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:27.335826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:27.344027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fd875bbb-3ce1-40d2-9a33-36cf713a24d0 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.150138 Jul 27 08:48:27.344588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 443/884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:27 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:27.913028 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:27.913665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:27.919841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:27.920287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:27.921043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:27.921473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:28.134266 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:28.134876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:28.141625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:28.142076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:28.142880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:28.143314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:28.283329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:28.293521 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:28.295162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:28.304900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-be0c7d27-df5b-47ee-8790-0617e569e330 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.166159 Jul 27 08:48:28.304900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 444/885] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:28 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 08:48:28.365236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:28.366162 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:28.373201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:28.375316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:28.375316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:28.375543 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:28.376013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:28.382977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-13062033-0ca2-44a9-a997-ac61254cc55a tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.473701 Jul 27 08:48:28.383628 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 442/886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:27 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:28.513262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:28.520887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-73cfeebc-a958-405f-a552-0b45988f5f0f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.159376 Jul 27 08:48:28.524782 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 445/887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:28 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:29.319435 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:29.320044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:29.326881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.327329 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.328095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.328530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.406201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:29.407215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:29.413637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.414080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.414881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.415307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.458066 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:29.466537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:29.468034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:29.469190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ac70ff09-3e5f-4501-aa25-3b8becb25455 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.153781 Jul 27 08:48:29.469747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 443/888] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:29 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:29.544562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:29.545171 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:29.545943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:29.551901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.552371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.553185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:29.553377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d5dd434c-bc7e-4d0e-8243-b9e89dfa5c36 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.151035 Jul 27 08:48:29.553634 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:29.554130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 446/889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:29 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:29.679273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:29.686873 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e584bd4e-0519-4604-a5a2-f330169a07a1 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.147155 Jul 27 08:48:29.687443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 444/890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:29 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:30.492493 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:30.493099 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:30.500482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.500932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.501696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.502136 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.574297 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:30.574911 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:30.581450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.581894 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.582692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.583127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.633039 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:30.642161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:30.643691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:30.644847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9308cbc7-731a-4917-b281-084dd201a4d6 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1728 microversion: 2.20 time: 0.156315 Jul 27 08:48:30.645401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 447/891] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:30 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:30.708319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:30.708930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:30.715169 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.715496 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:30.715632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.716619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:30.717052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:30.723257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-aa63bc51-74ab-415a-80e3-1929d016f6c8 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.153481 Jul 27 08:48:30.723833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 445/892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:30 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:31.075925 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:31.083405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4a54e572-6512-4fd9-8602-bae0ef57c44b tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.379086 Jul 27 08:48:31.083955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 448/893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:30 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:31.667458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:31.668083 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:31.674534 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:31.674982 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:31.675733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:31.676163 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:31.746251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:31.746876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:31.753204 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:31.754060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:31.754680 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:31.755196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:31.869596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:31.878472 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:31.880918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:31.882129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c03c09d6-ab66-4a16-b651-f485f52e7ac1 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1715 microversion: 2.20 time: 0.218709 Jul 27 08:48:31.882915 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 446/894] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:48:31 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1715 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:48:31.887746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:31.897331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7515bf49-f817-4c8b-b7b9-226334a47255 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.156306 Jul 27 08:48:31.898187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 449/895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:31 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:32.105648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:32.106181 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:32.112191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:32.112639 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:32.113396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:32.113827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:32.293114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:32.301029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b75b181a-4539-47ee-a865-aa5aaea31de4 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1672 microversion: 2.1 time: 0.199888 Jul 27 08:48:32.301738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 447/896] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:32 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:32.712735 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-ea01ee4a-2233-4789-ae00-ed70959d1d2a req-f5e28562-546c-4c15-a4e7-9246507ab289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b9d72-4d03-452a-9680-0724288c3351", "name": "network-vif-deleted", "tag": "6323d0f2-9c69-4ebc-8c31-26281bc1b864"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:32.725143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ea01ee4a-2233-4789-ae00-ed70959d1d2a req-f5e28562-546c-4c15-a4e7-9246507ab289 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:32.725779 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ea01ee4a-2233-4789-ae00-ed70959d1d2a req-f5e28562-546c-4c15-a4e7-9246507ab289 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:32.738429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-ea01ee4a-2233-4789-ae00-ed70959d1d2a req-f5e28562-546c-4c15-a4e7-9246507ab289 service nova] Creating event network-vif-deleted:6323d0f2-9c69-4ebc-8c31-26281bc1b864 for instance 198b9d72-4d03-452a-9680-0724288c3351 on hv-cinder-85117 Jul 27 08:48:32.743565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-ea01ee4a-2233-4789-ae00-ed70959d1d2a req-f5e28562-546c-4c15-a4e7-9246507ab289 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034903 Jul 27 08:48:32.745184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 450/897] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:48:32.921944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:32.922890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:32.929602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:32.930129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:32.930929 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:32.931391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:33.153995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:33.162101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1a87a4d4-bff0-41fb-943a-74e1e0d3854f tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.245016 Jul 27 08:48:33.176107 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 448/898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:32 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:33.323939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:33.324676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:33.331474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:33.337296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:33.337296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:33.337296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:33.368393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:33.369657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:33.370153 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lazy-loading 'fault' on Instance uuid 198b9d72-4d03-452a-9680-0724288c3351 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:33.414614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c29a83c5d2ce48eda587f2cec0e959ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcfebb6e1774a7daed20b60d2379875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:33.424150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-95968fe3-5891-4fdc-9749-557a77eb8da3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 200 len: 1327 microversion: 2.1 time: 0.105249 Jul 27 08:48:33.424740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 451/899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:33 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:34.183880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:34.184493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:34.191004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:34.191456 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:34.192229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:34.192660 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:34.323380 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:34.330777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ff2d6219-eb7f-4ee2-9c81-295e91fab164 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.151143 Jul 27 08:48:34.331339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 449/900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:34 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:34.444899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:34.445495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:34.452691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:34.453130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:34.453887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:34.454347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:34.467913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 HTTP/1.1 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:48:34.469520 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:34.471141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '198b9d72-4d03-452a-9680-0724288c3351'} Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:34.472047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:34.473340 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:34.474504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:34.474504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b454762d-975f-48f1-9258-b19668576b5f tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 404 len: 111 microversion: 2.1 time: 0.029962 Jul 27 08:48:34.474504 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 452/901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:34 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:34.479713 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5a71405f-3f5f-45a6-b66e-98b60fc96c0a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '.version_select at 0x7f78f149eb80>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:34.578802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5a71405f-3f5f-45a6-b66e-98b60fc96c0a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138000664" status: 202 len: 0 microversion: 2.1 time: 0.102834 Jul 27 08:48:34.579377 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 450/902] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Jul 27 08:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138000664 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:48:35.358803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:35.359438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:35.365659 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:35.366105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:35.366899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:35.373115 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-4df6a8a7-c8f9-4818-a54c-dbe1ce64c9c2 req-18ae23e3-7102-418d-887b-3f0d97ad377e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39de4969-6044-4fa4-b9d1-fe0d5d59da0d", "name": "network-vif-plugged", "status": "completed", "tag": "c867b62f-3e3b-47c7-a632-b1d7198b0f7b"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:35.379632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:35.387972 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4df6a8a7-c8f9-4818-a54c-dbe1ce64c9c2 req-18ae23e3-7102-418d-887b-3f0d97ad377e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:35.388424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-4df6a8a7-c8f9-4818-a54c-dbe1ce64c9c2 req-18ae23e3-7102-418d-887b-3f0d97ad377e service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:35.398920 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-4df6a8a7-c8f9-4818-a54c-dbe1ce64c9c2 req-18ae23e3-7102-418d-887b-3f0d97ad377e service nova] Creating event network-vif-plugged:c867b62f-3e3b-47c7-a632-b1d7198b0f7b for instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d on hv-cinder-85117 Jul 27 08:48:35.404542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-4df6a8a7-c8f9-4818-a54c-dbe1ce64c9c2 req-18ae23e3-7102-418d-887b-3f0d97ad377e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 Jul 27 08:48:35.405197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 451/903] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:35.521416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:35.529067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c20b12e1-63a7-4225-9238-f7755cc878de tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.174045 Jul 27 08:48:35.529619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 453/904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:35 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:36.551987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:36.552697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:36.554697 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:36.559813 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:36.560272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:36.561149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:36.563256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:36.693019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:36.701551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-203476fd-3b74-43da-83b2-1fc29cd247aa tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.154727 Jul 27 08:48:36.702120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 452/905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:36 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:37.722872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:37.723483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:37.730307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.730760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.731528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.731965 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.860985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:37.868406 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3a78853d-732b-4441-a873-bd15729b6de9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1313 microversion: 2.1 time: 0.149580 Jul 27 08:48:37.868955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 454/906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:37 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:37.899579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:37.900055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:37.907230 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.907665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.908423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.908856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.922569 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 HTTP/1.1 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:48:37.924229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.925733 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '198b9d72-4d03-452a-9680-0724288c3351'} Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:37.926853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.928356 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.930010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:37.930010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f42a8dbc-8e50-4c89-bdac-d3543d575b60 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 404 len: 111 microversion: 2.1 time: 0.029970 Jul 27 08:48:37.930010 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 453/907] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:48:37 2022] DELETE /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:37.934449 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:37.935055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: 198b9d72-4d03-452a-9680-0724288c3351] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:37.941011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.941459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.942248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:37.942686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:37.955884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 HTTP/1.1 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:48:37.957397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.958984 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '198b9d72-4d03-452a-9680-0724288c3351'} Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:37.959915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. Jul 27 08:48:37.961665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:37.963657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance 198b9d72-4d03-452a-9680-0724288c3351 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:37.963657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-246e7be9-daec-466b-bc3e-e02053491ad3 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351" status: 404 len: 111 microversion: 2.1 time: 0.028380 Jul 27 08:48:37.963657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 455/908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:37 2022] GET /compute/v2.1/servers/198b9d72-4d03-452a-9680-0724288c3351 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:38.889960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:38.890601 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:38.896702 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:38.897200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:38.897914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:38.898385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.040759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:39.049312 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-25dbe68a-473f-4167-99d5-33b663052510 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1497 microversion: 2.1 time: 0.163903 Jul 27 08:48:39.050533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 454/909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:38 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:39.214126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:39.214839 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:39.221719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.222210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.222968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.223410 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.237652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 HTTP/1.1 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:48:39.239209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.240564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'f7739cba-0102-4d24-ac1e-904912fe2c65'} Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:39.241810 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.243552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.245678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:39.245678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-88da25a4-6749-411e-b61b-778567846bc6 tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 404 len: 111 microversion: 2.1 time: 0.030652 Jul 27 08:48:39.245678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 456/910] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:48:39 2022] DELETE /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:39.249985 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:39.250620 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] [instance: f7739cba-0102-4d24-ac1e-904912fe2c65] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:39.256571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.257023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.259501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.259501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.271430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] HTTP exception thrown: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Request method failure captured: Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 HTTP/1.1 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnEXmgeobz-qu5315-82YWYcD_JN1cgUJ86TRKHm1ENSR-5tCJO7sQOF3R9arDSzlCpWYq4moMxXVTv5Do1smJmcwNJ6LOCJEXQnlY7k0ZqA6aFgw0-dWI8oa4rTWM8NCtBSY2Npn3yyh_D9DhkrQMfZeI58T2UL8Ti1lD3w91Ewmw Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:48:39.272938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9dcfebb6e1774a7daed20b60d2379875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9dcfebb6e1774a7daed20b60d2379875", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 9dcfebb6e1774a7daed20b60d2379875 Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127328781 Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c29a83c5d2ce48eda587f2cec0e959ce Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeTestJSON-127328781-project Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.274612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'f7739cba-0102-4d24-ac1e-904912fe2c65'} Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:39.276185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. Jul 27 08:48:39.277670 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:39.279254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] Returning 404 to user: Instance f7739cba-0102-4d24-ac1e-904912fe2c65 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:39.279254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-68e037f3-36ee-4399-9fff-6cab4d36165a tempest-AttachVolumeTestJSON-127328781 tempest-AttachVolumeTestJSON-127328781-project] 10.222.0.40 "GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65" status: 404 len: 111 microversion: 2.1 time: 0.028424 Jul 27 08:48:39.279254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 455/911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:39 2022] GET /compute/v2.1/servers/f7739cba-0102-4d24-ac1e-904912fe2c65 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:39.910816 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:39.911306 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:39.917619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.918067 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.918854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:39.919286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:39.944960 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:48:40.112113 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:40.286715 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3c336b54-94a5-4adc-bc4b-51279dcce20d tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "DELETE /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 204 len: 0 microversion: 2.1 time: 0.379243 Jul 27 08:48:40.288263 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 457/912] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:48:39 2022] DELETE /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:48:40.297349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:40.298006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:40.305499 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:40.306277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:40.307457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:40.307899 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:40.761353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:40.769963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7a3f0f50-3f53-4f5a-98c0-3268738536ac tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1503 microversion: 2.1 time: 0.476479 Jul 27 08:48:40.770566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 456/913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:40 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:41.791916 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:41.792570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:41.799953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:41.800406 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:41.801202 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:41.801641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:41.989424 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:41.997581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f3c26a8d-835d-4257-a2b9-77bb2910bade tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1503 microversion: 2.1 time: 0.210058 Jul 27 08:48:42.002379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 458/914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:41 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:42.584524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-687e5efd-878f-4dc1-95bc-63f012533b46 req-0f51a383-edeb-47df-92f7-4d766e224736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39de4969-6044-4fa4-b9d1-fe0d5d59da0d", "name": "network-vif-deleted", "tag": "c867b62f-3e3b-47c7-a632-b1d7198b0f7b"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:42.605978 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-687e5efd-878f-4dc1-95bc-63f012533b46 req-0f51a383-edeb-47df-92f7-4d766e224736 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:42.606459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-687e5efd-878f-4dc1-95bc-63f012533b46 req-0f51a383-edeb-47df-92f7-4d766e224736 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:42.626550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-687e5efd-878f-4dc1-95bc-63f012533b46 req-0f51a383-edeb-47df-92f7-4d766e224736 service nova] Creating event network-vif-deleted:c867b62f-3e3b-47c7-a632-b1d7198b0f7b for instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d on hv-cinder-85117 Jul 27 08:48:42.657766 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-687e5efd-878f-4dc1-95bc-63f012533b46 req-0f51a383-edeb-47df-92f7-4d766e224736 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077968 Jul 27 08:48:42.662878 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 457/915] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:48:43.019030 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:43.019660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:43.028238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:43.028734 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:43.029630 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:43.029951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:43.064784 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:43.065226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:43.065701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lazy-loading 'fault' on Instance uuid 39de4969-6044-4fa4-b9d1-fe0d5d59da0d {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:43.121468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb7349917df46f7a2b2d98a47b91c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1afe245d7045de99b1c9a2d13f2822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:43.128797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-148cb43b-0d11-4b04-8889-02e14f9583c6 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 200 len: 1303 microversion: 2.1 time: 0.114237 Jul 27 08:48:43.129350 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 459/916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:43 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:44.153762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:44.154504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] [instance: 39de4969-6044-4fa4-b9d1-fe0d5d59da0d] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:44.161127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:44.161567 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:44.162362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:44.162796 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:44.175864 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] HTTP exception thrown: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Request method failure captured: Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d HTTP/1.1 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PurSxZNNgpxAeTlFeQWMDGga24Pn6uSZ1jQwuZKZw_ZoJ0JpApEnxZ_KdPE8_1hR0De_Bwh4W9QT0UqMwscV5HF8OpXrcZHfavH6ya2WeItmIJCBjlJ6A_Q2RfOqa-gbTX6pkW1T3hqt0JbFjh48SPb8EvuvKjkioQL0dk8c_z14zI Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 1e1afe245d7045de99b1c9a2d13f2822 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesActionsTest-703864075 Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:48:44.177629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1e1afe245d7045de99b1c9a2d13f2822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1e1afe245d7045de99b1c9a2d13f2822", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesActionsTest-703864075 Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 1e1afe245d7045de99b1c9a2d13f2822 Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesActionsTest-703864075 Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesActionsTest-703864075-project Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: ebb7349917df46f7a2b2d98a47b91c1f Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesActionsTest-703864075-project Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. Jul 27 08:48:44.179012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '39de4969-6044-4fa4-b9d1-fe0d5d59da0d'} Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:48:44.179740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. Jul 27 08:48:44.180946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:48:44.182089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] Returning 404 to user: Instance 39de4969-6044-4fa4-b9d1-fe0d5d59da0d could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:48:44.182089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9b5cebca-e574-4cc9-9e2a-004ad6e1e4f9 tempest-VolumesActionsTest-703864075 tempest-VolumesActionsTest-703864075-project] 10.222.0.40 "GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d" status: 404 len: 111 microversion: 2.1 time: 0.030407 Jul 27 08:48:44.182089 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 458/917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:44 2022] GET /compute/v2.1/servers/39de4969-6044-4fa4-b9d1-fe0d5d59da0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:48:56.255483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:56.257624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=14 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:56.262385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:48:56.264416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:56.271071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:56.271818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:56.272764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:56.273199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:56.305748 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lazy-loading 'flavor' on Instance uuid 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:48:56.599416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-fdc37346-2d29-4c85-9892-4d3033e68778 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "POST /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b/action" status: 202 len: 0 microversion: 2.1 time: 0.344229 Jul 27 08:48:56.600409 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 460/918] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:48:56 2022] POST /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:48:56.609851 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:56.610695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:56.618506 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=13 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:56.619220 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=87 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:48:56.628228 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:56.631716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:56.631716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:56.631716 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:56.809388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:56.818273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-12d6bae7-9405-4437-9461-e405b34038b7 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.213159 Jul 27 08:48:56.819058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 459/919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:56 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:48:57.856741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:57.858027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:57.865631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:57.866085 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:57.866867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:57.867295 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:58.023787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:58.032514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4104790a-ffcf-4b8f-b594-1772390c2464 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.180853 Jul 27 08:48:58.035644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 461/920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:57 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:48:59.057625 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:48:59.059192 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:48:59.066226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:59.066823 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:59.067725 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:48:59.068474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:48:59.221173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:48:59.230262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f3f65f0d-d159-49d4-828a-a46d2e18f431 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.176957 Jul 27 08:48:59.231296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 460/921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:48:59 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:00.252469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:00.253029 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:00.259600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:00.260050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:00.260819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:00.261797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:00.399997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:00.408075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f8f3f2a7-9f70-4654-88cf-612d22a14e06 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.159647 Jul 27 08:49:00.408633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 462/922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:00 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:01.429095 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:01.430292 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:01.436596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:01.437081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:01.437858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:01.438384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:01.597953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:01.612621 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d5dd68dc-aa79-4c9e-aa77-cab6c6d8c086 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.187226 Jul 27 08:49:01.613692 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 461/923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:01 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:02.638098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:02.638723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:02.646169 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:02.646906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:02.647887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:02.648509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:02.811652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:02.819671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c2275225-f1bc-48db-ac0c-8e9e6ce9a319 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.185850 Jul 27 08:49:02.825503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 463/924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:02 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:03.851892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:03.853282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:03.861608 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:03.862451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:03.863668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:03.864388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:04.046663 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:04.055382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f39a9959-b0b0-4f15-bbbf-446b009168b4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.208327 Jul 27 08:49:04.056537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 462/925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:03 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:05.081292 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:05.081851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:05.088480 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:05.089141 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:05.090782 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:05.091637 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:05.312697 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:05.321117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b5917b24-1774-4fcf-9d18-fe891a9f93bc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.244166 Jul 27 08:49:05.338238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 464/926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:05 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:06.343770 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:06.344471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:06.359676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:06.359867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:06.360672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:06.361121 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:06.525200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:06.533582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-af6444c8-fad7-4fc2-b342-c914b30671cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.194228 Jul 27 08:49:06.534176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 463/927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:06 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:07.554898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:07.556573 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:07.563510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:07.564374 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:07.565500 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:07.566074 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:07.731037 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:07.739357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-471cc083-d759-4e21-863f-c54b51ca0315 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.188720 Jul 27 08:49:07.740005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 465/928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:07 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:08.761532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:08.762227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:08.768760 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:08.769205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:08.769963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:08.770424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:08.906036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:08.913811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-537fee06-b4c6-430c-8adb-898cbcaf2f90 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.156188 Jul 27 08:49:08.914414 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 464/929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:08 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:09.938740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:09.938740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:09.947004 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:09.947801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:09.948629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:09.949714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:10.089889 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:10.097921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-83c7ed70-8dab-4437-af90-98521cbba922 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.166084 Jul 27 08:49:10.098476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 466/930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:09 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:11.120983 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:11.122561 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:11.128875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.129332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.130111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.130591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.276384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:11.285428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-62f57b90-03fe-44e1-8934-c0b023fdd0e8 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1570 microversion: 2.1 time: 0.168671 Jul 27 08:49:11.285990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 465/931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:11 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:11.306882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:11.307474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:11.314414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.315080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.315860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.316296 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.562074 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-04b93e21-d98c-4c6a-a8f6-83bfb177c6f6 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "POST /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b/action" status: 202 len: 0 microversion: 2.1 time: 0.258871 Jul 27 08:49:11.562957 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 467/932] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Jul 27 08:49:11 2022] POST /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:49:11.571759 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:11.572810 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:11.581432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.581932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.582948 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:11.583379 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:11.792578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:11.798428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0f994237-585d-43d2-b3e3-9fa229e2f5f1 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1518 microversion: 2.1 time: 0.230827 Jul 27 08:49:11.799304 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 466/933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:11 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1518 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:12.819398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:12.821365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:12.829199 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:12.829654 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:12.830453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:12.830888 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:12.970407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:12.978331 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d36a991d-75ff-455c-9019-7779195e799b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1520 microversion: 2.1 time: 0.162669 Jul 27 08:49:12.978903 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 468/934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:12 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:13.421643 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-02d24360-76f9-439a-b158-2f7a8e4eb13c req-7377580d-8322-4142-9d62-f3a0a6fadd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "name": "network-vif-unplugged", "status": "completed", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:13.431976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-02d24360-76f9-439a-b158-2f7a8e4eb13c req-7377580d-8322-4142-9d62-f3a0a6fadd85 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:13.432482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-02d24360-76f9-439a-b158-2f7a8e4eb13c req-7377580d-8322-4142-9d62-f3a0a6fadd85 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:13.443859 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.compute.server_external_events [req-02d24360-76f9-439a-b158-2f7a8e4eb13c req-7377580d-8322-4142-9d62-f3a0a6fadd85 service nova] Unable to find a host for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b. Dropping event network-vif-unplugged {{(pid=129924) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 08:49:13.444769 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-02d24360-76f9-439a-b158-2f7a8e4eb13c req-7377580d-8322-4142-9d62-f3a0a6fadd85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027786 Jul 27 08:49:13.445510 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 467/935] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 08:49:14.001379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:14.001993 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:14.013137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:14.013137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:14.013137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:14.013137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:14.161633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:14.170015 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-45a85fc0-5c0c-4f65-bc9c-dbcd82a3d6ba tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1520 microversion: 2.1 time: 0.173152 Jul 27 08:49:14.170617 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 469/936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:13 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:15.195957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:15.196580 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:15.205430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:15.206427 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:15.207767 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:15.208363 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:15.424008 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:15.431992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0ea96018-4eb8-4038-86cf-164505ba5f39 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.239802 Jul 27 08:49:15.433058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 468/937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:15 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:16.455789 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:16.456426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:16.463010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:16.463455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:16.464223 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:16.464914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:16.602043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:16.609964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4a5af167-0e25-4ac7-9c65-6d1b3940c4ac tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.159270 Jul 27 08:49:16.611000 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 470/938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:16 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:16.956784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:16.957897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:16.964731 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:16.965495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:16.966296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:16.966986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:16.991802 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-81799f00-82d3-4392-a0ab-4b8d838989cc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/ips" status: 200 len: 150 microversion: 2.1 time: 0.038577 Jul 27 08:49:16.992626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 469/939] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Jul 27 08:49:16 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:17.631873 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:17.632507 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:17.639489 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:17.639935 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:17.640708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:17.641291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:17.779720 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:17.801289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4ea59a9f-81eb-4182-aa05-698068a8af48 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.173245 Jul 27 08:49:17.802109 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 471/940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:17 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:18.824636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:18.825262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:18.831954 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:18.832393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:18.833157 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:18.833586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:18.860396 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7972c52-7880-481c-9c62-bc75e944a503"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:18.863021 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:18.869736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:18.870201 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:18.871619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:18.872230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:18.979705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:18.988186 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-449ebddd-3c3f-44aa-8086-e03c205ccde2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.168080 Jul 27 08:49:18.988762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 470/941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:18 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:19.557742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:19.763202 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1b20fe12-bf61-49ca-938e-92dd58ecfd34 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "POST /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907034 Jul 27 08:49:19.763818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 472/942] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:49:18 2022] POST /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:49:20.009917 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:20.010588 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:20.017307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:20.017749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:20.018535 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:20.018966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:20.148638 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:20.156812 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-30601b3c-20ea-42f2-b6df-aa63a9668a93 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.151058 Jul 27 08:49:20.157570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 471/943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:20 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:21.179719 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:21.180358 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:21.186684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:21.187133 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:21.187890 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:21.188323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:21.320910 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:21.329105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ba892fef-452c-41a9-a15b-0d4479d874c2 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.154451 Jul 27 08:49:21.329665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 473/944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:21 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:22.350914 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:22.351479 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:22.358941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:22.359385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:22.360138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:22.360624 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:22.496261 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:22.504015 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-945a9cb1-9f98-40df-80d6-42395958ff97 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.157137 Jul 27 08:49:22.504571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 472/945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:22 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:23.524844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:23.525449 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:23.532237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:23.532681 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:23.533438 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:23.533924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:23.664090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:23.672849 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b17fdaea-9ca3-4794-bd01-d08fe61c4275 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.151921 Jul 27 08:49:23.673425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 474/946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:23 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:24.695082 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:24.695718 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:24.702949 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:24.703397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:24.704172 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:24.704612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:24.833158 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:24.840870 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e059c50a-f107-4664-a463-93758b1dd60b tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.149643 Jul 27 08:49:24.841678 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 473/947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:24 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:25.862742 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:25.863351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:25.869711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:25.870156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:25.870936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:25.871379 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:25.999049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:26.006407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d39c11c0-0a7b-49d6-b125-0fdcc212f3ad tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.147609 Jul 27 08:49:26.006974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 475/948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:25 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:27.027481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:27.028131 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:27.030561 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=31 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.035380 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:27.035825 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:27.036593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:27.037022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:27.041023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=85 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.170911 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:27.178871 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-50a8ec58-d856-4308-91e1-00a90b9e515c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.155318 Jul 27 08:49:27.179440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 474/949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:27 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:28.200598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:28.201234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:28.204332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=35 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:28.209414 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:28.209893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:28.210691 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:28.211125 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:28.501786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:28.509170 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1a1f9030-1241-45df-9b63-8d4a3a5f6346 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.312633 Jul 27 08:49:28.509727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 476/950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:28 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:29.531631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:29.532203 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:29.537994 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:29.538477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:29.539266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:29.539710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:29.669197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:29.676955 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d7732062-9e9c-4949-93aa-e9df908f9841 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.150774 Jul 27 08:49:29.677518 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 475/951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:29 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:30.300479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-d21de574-3de7-4701-90f8-69e2e04faa40 req-d1963957-ac74-440f-b8af-7663dd3eb79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "name": "network-vif-plugged", "status": "completed", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:30.312058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-d21de574-3de7-4701-90f8-69e2e04faa40 req-d1963957-ac74-440f-b8af-7663dd3eb79c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:30.312496 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-d21de574-3de7-4701-90f8-69e2e04faa40 req-d1963957-ac74-440f-b8af-7663dd3eb79c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:30.323101 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-d21de574-3de7-4701-90f8-69e2e04faa40 req-d1963957-ac74-440f-b8af-7663dd3eb79c service nova] Creating event network-vif-plugged:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:49:30.328732 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-d21de574-3de7-4701-90f8-69e2e04faa40 req-d1963957-ac74-440f-b8af-7663dd3eb79c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Jul 27 08:49:30.329324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 477/952] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:30.698108 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:30.699326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:30.707282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:30.707784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:30.708787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:30.709382 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:30.833790 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:49:30.833963 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 08:49:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:49:31.129522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:31.137158 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-227fba6b-15d1-4645-ae04-b94d7826959a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.443071 Jul 27 08:49:31.137717 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 476/953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:30 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:32.160148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:32.160835 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:32.167033 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:32.167475 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:32.168219 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:32.168652 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:32.301156 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:32.308633 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ba0a38ce-5c82-44c4-8de0-6b9b6d7745f4 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.153302 Jul 27 08:49:32.309109 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 478/954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:32 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:33.329922 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:33.330538 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:33.337043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:33.337488 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:33.338273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:33.338705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:33.522899 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:33.531070 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ff8cc0af-8acd-4f94-b470-8761926d9b61 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.204978 Jul 27 08:49:33.531631 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 477/955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:33 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:34.552801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:34.553402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:34.559686 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:34.560135 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:34.560887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:34.561388 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:34.695848 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:34.703764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-69af6e1f-f9d0-4d19-a258-2d281081227c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.154862 Jul 27 08:49:34.704326 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 479/956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:34 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:35.728530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:35.729149 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:35.736474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:35.736926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:35.737696 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:35.738136 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:35.870826 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:35.878701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-93885f0f-48aa-4eea-be59-d8a7d692fccb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.153972 Jul 27 08:49:35.879274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 478/957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:35 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:36.901019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:36.901623 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:36.909129 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:36.909580 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:36.910380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:36.910812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:37.060449 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:37.068416 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-326a1d57-7520-486f-b472-083b07da5bde tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1576 microversion: 2.1 time: 0.171241 Jul 27 08:49:37.069103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 480/958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:36 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:38.089936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:38.090595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:38.097528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:38.097971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:38.098775 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:38.099205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:38.234061 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:38.241928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-81385125-65c2-4156-8d61-c46815eba27e tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1563 microversion: 2.1 time: 0.155759 Jul 27 08:49:38.242536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 479/959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:38 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:39.079995 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:39.080492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:39.087051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:39.087498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:39.088455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:39.088944 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:39.169664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'services' on Instance uuid 1e8bed67-af36-4697-a38a-a67f2023ddd4 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:49:39.398121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-51398b5c-874e-4d00-baff-b576801e577f tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments/f7972c52-7880-481c-9c62-bc75e944a503" status: 202 len: 0 microversion: 2.1 time: 0.321887 Jul 27 08:49:39.398670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 481/960] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:49:39 2022] DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments/f7972c52-7880-481c-9c62-bc75e944a503 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 08:49:39.408210 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:39.410405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:39.416991 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:39.417433 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:39.418218 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:39.418653 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:39.447452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d706e9e1-8789-4d5f-b900-992d6cffbcfc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Jul 27 08:49:39.448001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 480/961] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:49:39 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:40.461196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:40.463355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:40.470324 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:40.470893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:40.471647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:40.472075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:40.501031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-aa5f0088-1fcf-4b7a-ac0e-65cc14c78222 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Jul 27 08:49:40.501570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 482/962] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:49:40 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:41.513537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:41.515703 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:41.522349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.524360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:41.524360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.524360 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:41.553173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6962a624-5363-4a3e-8696-d022b7434386 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043725 Jul 27 08:49:41.553975 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 481/963] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Jul 27 08:49:41 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:49:41.636711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:41.637309 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:41.643985 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.644423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:41.645173 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.645599 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:41.670114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:49:41.965282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d196511e-bedd-49d6-80cf-0b74916e9d8c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 204 len: 0 microversion: 2.1 time: 0.332118 Jul 27 08:49:41.965870 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 483/964] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:49:41 2022] DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:41.974867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:41.975478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:41.981452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.981903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:41.982704 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:41.983141 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:42.114046 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:42.121584 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-cf9d1a18-1c20-488f-be40-c7b3a8d289d8 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1682 microversion: 2.1 time: 0.150542 Jul 27 08:49:42.122279 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 482/965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:41 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:43.144524 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:43.145236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:43.152188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:43.154979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:43.154979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:43.154979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:43.291401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:43.300344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4634124e-6823-49f4-899e-559cd54c4a37 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1682 microversion: 2.1 time: 0.160737 Jul 27 08:49:43.301103 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 484/966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:43 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:44.323036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:44.323605 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:44.331135 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:44.331591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:44.332445 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:44.332844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:44.570092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:44.578662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d474d298-1796-4ae5-9f01-4978ba057324 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1682 microversion: 2.1 time: 0.259256 Jul 27 08:49:44.579234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 483/967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:44 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1682 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:45.088819 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-c35184f1-879c-429d-8d7d-8ec1740b5b5a req-d305f107-d107-44b6-8d4c-bf87c4077a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8bed67-af36-4697-a38a-a67f2023ddd4", "name": "network-vif-deleted", "tag": "431e23f4-5504-40f2-986d-b204f33f480c"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:45.102515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-c35184f1-879c-429d-8d7d-8ec1740b5b5a req-d305f107-d107-44b6-8d4c-bf87c4077a0a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:45.103051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-c35184f1-879c-429d-8d7d-8ec1740b5b5a req-d305f107-d107-44b6-8d4c-bf87c4077a0a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:45.115370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-c35184f1-879c-429d-8d7d-8ec1740b5b5a req-d305f107-d107-44b6-8d4c-bf87c4077a0a service nova] Creating event network-vif-deleted:431e23f4-5504-40f2-986d-b204f33f480c for instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 on hv-cinder-85117 Jul 27 08:49:45.120282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-c35184f1-879c-429d-8d7d-8ec1740b5b5a req-d305f107-d107-44b6-8d4c-bf87c4077a0a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035594 Jul 27 08:49:45.120882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 485/968] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:45.603327 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:45.604004 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:45.610884 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:45.611347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:45.612341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:45.612783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:45.645880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:45.646392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:45.646842 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lazy-loading 'fault' on Instance uuid 1e8bed67-af36-4697-a38a-a67f2023ddd4 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:49:45.694799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c370dd8fa3aa407ca22cce8425fcbc25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940250de2f6f47ed9edc1bb0468551c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:45.703455 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-500198e2-68a2-4944-aec3-609378d16b72 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 200 len: 1331 microversion: 2.1 time: 0.106822 Jul 27 08:49:45.710027 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 484/969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:45 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:46.726876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:46.732677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:46.734601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:46.735053 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:46.735817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:46.736245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:46.749666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 HTTP/1.1 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:49:46.751310 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:46.752951 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '1e8bed67-af36-4697-a38a-a67f2023ddd4'} Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:46.762209 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:46.763788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:46.765832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:46.765832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0d48f1a0-cfaf-403a-9014-0f42592e9abc tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 404 len: 111 microversion: 2.1 time: 0.030776 Jul 27 08:49:46.765832 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 486/970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:46 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 08:49:46.766081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-88def706-f813-4ef5-a490-ebeb7a17d998 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '.version_select at 0x7f78f55c09d0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:46.834868 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-88def706-f813-4ef5-a490-ebeb7a17d998 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011499174" status: 202 len: 0 microversion: 2.1 time: 0.076711 Jul 27 08:49:46.835451 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 485/971] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Jul 27 08:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011499174 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:49:52.360362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:52.362536 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:52.369216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.369667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.370462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.370901 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.373371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:52.401506 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-794ef5ed-3d1d-4627-b86e-75f6c9944193 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045808 Jul 27 08:49:52.402049 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 487/972] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Jul 27 08:49:52 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:52.463910 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:52.464421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:52.474112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.474595 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.475371 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.475808 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.501609 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:49:52.803398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2bf4abcc-3e4f-4a46-9541-d1290a580f7c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 204 len: 0 microversion: 2.20 time: 0.343682 Jul 27 08:49:52.803903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 486/973] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Jul 27 08:49:52 2022] DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 08:49:52.812513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:52.813127 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:52.819744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.820189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.820954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:52.821390 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:52.954459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:52.962501 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:52.964002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:52.965155 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e1b5d050-f0b6-44fd-b63d-fcf8c8d0453c tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.156993 Jul 27 08:49:52.965692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 488/974] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:49:52 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:49:53.242952 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:53.243537 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:53.250367 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.250814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:53.251576 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.252014 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:53.266050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 HTTP/1.1 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:49:53.267724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.269368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '1e8bed67-af36-4697-a38a-a67f2023ddd4'} Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:53.270326 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.271971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.273443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:53.273443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e67ce9e4-d122-406e-9a52-5820c29e324c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 404 len: 111 microversion: 2.1 time: 0.030387 Jul 27 08:49:53.273443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 487/975] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:49:53 2022] DELETE /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:53.277465 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:53.278753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 1e8bed67-af36-4697-a38a-a67f2023ddd4] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:53.284295 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.284750 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:53.285518 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.285955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:53.299598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 HTTP/1.1 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:49:53.301143 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.303248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '1e8bed67-af36-4697-a38a-a67f2023ddd4'} Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:53.304137 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. Jul 27 08:49:53.305945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:53.307273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 1e8bed67-af36-4697-a38a-a67f2023ddd4 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:53.307273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-11b0a113-da33-435d-b56e-71054bddaef9 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4" status: 404 len: 111 microversion: 2.1 time: 0.028873 Jul 27 08:49:53.307273 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 489/976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:53 2022] GET /compute/v2.1/servers/1e8bed67-af36-4697-a38a-a67f2023ddd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:53.989492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:53.990102 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:53.996578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.997029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:53.997797 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:53.998269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.193852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:54.202503 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:54.204081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:54.205252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-63efa6de-0776-456e-93a3-5148314df2d8 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1721 microversion: 2.20 time: 0.219670 Jul 27 08:49:54.207233 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 488/977] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:49:53 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:49:54.575241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:54.575743 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:54.581868 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.582397 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.583190 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.583628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.597687 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 HTTP/1.1 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:49:54.599312 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.600920 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '159ef74b-f7ad-4522-a24f-174383d37309'} Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:54.601763 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.603251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.604856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:54.604856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ead927b7-759c-4dcb-b692-5fd2a69380a5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 404 len: 111 microversion: 2.1 time: 0.029487 Jul 27 08:49:54.604856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 490/978] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:49:54 2022] DELETE /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:54.614626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:54.614626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 159ef74b-f7ad-4522-a24f-174383d37309] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:54.617450 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.617896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.618680 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.619119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.632682 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 HTTP/1.1 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:49:54.634368 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.635993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '159ef74b-f7ad-4522-a24f-174383d37309'} Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:54.637091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. Jul 27 08:49:54.639238 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.640684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 159ef74b-f7ad-4522-a24f-174383d37309 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:54.640684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-797fc45a-7a15-4f37-a087-d87d2cafeca5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309" status: 404 len: 111 microversion: 2.1 time: 0.029356 Jul 27 08:49:54.640684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 489/979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:54 2022] GET /compute/v2.1/servers/159ef74b-f7ad-4522-a24f-174383d37309 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:54.644221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:54.644723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:54.651219 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.655385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.655385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.655385 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.667866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc HTTP/1.1 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:49:54.669355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.671759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '80c4e570-1a1e-48ce-a477-0c84bcec9fbc'} Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:54.672866 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.674332 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.675937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:54.675937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e906e8b9-e143-4ea6-b961-fc990b6a337c tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 404 len: 111 microversion: 2.1 time: 0.031091 Jul 27 08:49:54.675937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 491/980] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:49:54 2022] DELETE /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:54.680043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:54.680675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: 80c4e570-1a1e-48ce-a477-0c84bcec9fbc] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:54.689728 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.692011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.692011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:54.692011 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:54.705362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc HTTP/1.1 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:49:54.706938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.708397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '80c4e570-1a1e-48ce-a477-0c84bcec9fbc'} Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:54.710661 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. Jul 27 08:49:54.712253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:54.713610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance 80c4e570-1a1e-48ce-a477-0c84bcec9fbc could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:54.713610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3ef5a3b0-f4c3-4188-a971-d80f7d0d2dfb tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc" status: 404 len: 111 microversion: 2.1 time: 0.032226 Jul 27 08:49:54.713610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 490/981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:54 2022] GET /compute/v2.1/servers/80c4e570-1a1e-48ce-a477-0c84bcec9fbc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:55.455474 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:55.456090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:55.463157 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:55.463603 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:55.464404 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:55.465164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:55.573337 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:55.585470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:55.587882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:55.589234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-cbb717cb-bbb5-4df1-932b-1e21b84cdc55 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1654 microversion: 2.20 time: 0.362383 Jul 27 08:49:55.589954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 492/982] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:49:55 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1654 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:49:55.781375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-6d0c60e3-3b33-47d2-beaa-45d5458304f7 req-56647160-ee18-4388-90f3-cc34b4a13139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e039946f-9689-47a3-85ab-cdd76c8ab6be", "name": "network-vif-deleted", "tag": "cbc21c19-a9c2-48e6-88bd-b5b02cd593fb"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:49:55.792735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6d0c60e3-3b33-47d2-beaa-45d5458304f7 req-56647160-ee18-4388-90f3-cc34b4a13139 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:55.793514 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-6d0c60e3-3b33-47d2-beaa-45d5458304f7 req-56647160-ee18-4388-90f3-cc34b4a13139 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:55.807546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-6d0c60e3-3b33-47d2-beaa-45d5458304f7 req-56647160-ee18-4388-90f3-cc34b4a13139 service nova] Creating event network-vif-deleted:cbc21c19-a9c2-48e6-88bd-b5b02cd593fb for instance e039946f-9689-47a3-85ab-cdd76c8ab6be on hv-cinder-85117 Jul 27 08:49:55.813477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-6d0c60e3-3b33-47d2-beaa-45d5458304f7 req-56647160-ee18-4388-90f3-cc34b4a13139 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194842 Jul 27 08:49:55.814096 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 491/983] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:49:56.087867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:56.088454 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:56.096762 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.099796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.100685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.101134 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.124380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e HTTP/1.1 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:49:56.126036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.127655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'ba1df927-86a0-4ed5-aad6-b45dd817b46e'} Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:56.128482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.129700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.131307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:56.131307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bd4cd643-ac0a-460b-adc1-a199d5225505 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 404 len: 111 microversion: 2.1 time: 0.043907 Jul 27 08:49:56.131307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 493/984] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:49:56 2022] DELETE /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 08:49:56.137591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:56.138542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] [instance: ba1df927-86a0-4ed5-aad6-b45dd817b46e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:56.147332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.147993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.148993 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.149432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.164333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] HTTP exception thrown: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Request method failure captured: Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e HTTP/1.1 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnHxadApETR5c__uAxgbJ6F6-FPbP_PjlflprPxbQrZaxHHUlb2wlIkYv8-j5jDf_4bBFlFucNPxTrvfYQE0W7GlTmp7vjB_rsDUXzVqfo-J3FWY8sj7XM1lX2XhXBgpafVlFBcCYjTVY9XPm2b5-Wxpwd0iTgOnRCTlnRbDaNk32c Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:49:56.166052 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/940250de2f6f47ed9edc1bb0468551c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_940250de2f6f47ed9edc1bb0468551c8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 940250de2f6f47ed9edc1bb0468551c8 Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-406435816 Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c370dd8fa3aa407ca22cce8425fcbc25 Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeNegativeTest-406435816-project Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.167664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'ba1df927-86a0-4ed5-aad6-b45dd817b46e'} Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:56.168441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. Jul 27 08:49:56.169711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:56.173223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] Returning 404 to user: Instance ba1df927-86a0-4ed5-aad6-b45dd817b46e could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:56.173223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-389ddbfd-6697-4105-895c-bdec77f938c5 tempest-AttachVolumeNegativeTest-406435816 tempest-AttachVolumeNegativeTest-406435816-project] 10.222.0.40 "GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e" status: 404 len: 111 microversion: 2.1 time: 0.034450 Jul 27 08:49:56.173223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 492/985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:49:56 2022] GET /compute/v2.1/servers/ba1df927-86a0-4ed5-aad6-b45dd817b46e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:56.727126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:56.727126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:56.727126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.727126 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.728288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.728288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.728288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:56.728288 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:56.728644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lazy-loading 'fault' on Instance uuid e039946f-9689-47a3-85ab-cdd76c8ab6be {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:49:56.977423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:56.985361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:56.986909 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26128a80933f4be3bed504d7a2d2785f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c60f49a9e14417bd1d9504128fc94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:49:56.988284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0f71e80c-5cd4-4f6e-ae2d-811f666385c7 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 200 len: 1370 microversion: 2.20 time: 0.376218 Jul 27 08:49:56.989330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 494/986] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:49:56 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:49:58.012385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:58.013164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:49:58.016256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:58.021142 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:58.021592 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:58.022384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:49:58.022817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:49:58.025395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:58.038132 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be HTTP/1.1 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:49:58.040079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:49:58.041953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'e039946f-9689-47a3-85ab-cdd76c8ab6be'} Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:49:58.050542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:49:58.052152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:49:58.053664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:49:58.053664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8116171a-4609-4629-9621-065292fe5563 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 404 len: 111 microversion: 2.20 time: 0.032966 Jul 27 08:49:58.053664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 493/987] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:49:58 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 08:49:58.054114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-71d79ef4-70b0-4f23-8a1b-4318f825090f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '.version_select at 0x7f78f0c115e0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:49:58.175539 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-71d79ef4-70b0-4f23-8a1b-4318f825090f tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603783285" status: 204 len: 0 microversion: 2.20 time: 0.128646 Jul 27 08:49:58.176148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 495/988] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Jul 27 08:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603783285 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 08:50:00.767032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:00.773901 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:50:00.775076 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:00.775528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:00.776350 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:00.776739 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:00.792030 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be HTTP/1.1 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:50:00.794372 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.796854 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'e039946f-9689-47a3-85ab-cdd76c8ab6be'} Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:50:00.798079 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.807399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.810931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:50:00.810931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2ffb5be0-fe2b-4add-be21-14612050dedc tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 404 len: 111 microversion: 2.20 time: 0.034972 Jul 27 08:50:00.810931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 494/989] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Jul 27 08:50:00 2022] DELETE /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:50:00.811629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:00.811629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: e039946f-9689-47a3-85ab-cdd76c8ab6be] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:50:00.811629 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:00.816639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:00.817090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:00.817884 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:00.818351 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:00.833111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be HTTP/1.1 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:50:00.834696 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.836218 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'e039946f-9689-47a3-85ab-cdd76c8ab6be'} Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:50:00.836996 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. Jul 27 08:50:00.838236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:00.844104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance e039946f-9689-47a3-85ab-cdd76c8ab6be could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:50:00.844104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-07f2f99e-c9df-418c-b5a5-d8420ff7e856 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be" status: 404 len: 111 microversion: 2.20 time: 0.034957 Jul 27 08:50:00.844104 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 496/990] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:50:00 2022] GET /compute/v2.1/servers/e039946f-9689-47a3-85ab-cdd76c8ab6be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 08:50:02.192504 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:02.193009 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:50:02.200481 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:02.200932 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:02.201699 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:02.203057 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:02.219749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 HTTP/1.1 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:50:02.221391 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.222815 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '73303fae-c87c-4ca8-86ef-f53a66bb47d9'} Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:50:02.223711 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.225346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.226951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:50:02.226951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-21d14750-f017-4a5c-8dad-7889ffd76dbe tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 404 len: 111 microversion: 2.20 time: 0.034578 Jul 27 08:50:02.226951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 495/991] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Jul 27 08:50:02 2022] DELETE /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:50:02.232176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:02.232876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] [instance: 73303fae-c87c-4ca8-86ef-f53a66bb47d9] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:50:02.240370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:02.240823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:02.241597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:50:02.242060 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:50:02.258529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] HTTP exception thrown: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Request method failure captured: Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 HTTP/1.1 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PnB6zLCmR5hnSMSn1UQcqS272PxMxlzcN0SA4Ns6cJXPkWBK-0uANiqSrlEB8vAE8Tc2BSW0tm2qVWBzl0a2zKEKj5JYBeI2bnrqoOz9ejfsVXa4wjXgSlAv_ZMfsc2YERoT_DWy2opMrb3t2c7I1wATg5B9OfL85r8iqP39acW53o Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:50:02.260114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e2c60f49a9e14417bd1d9504128fc94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e2c60f49a9e14417bd1d9504128fc94b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e2c60f49a9e14417bd1d9504128fc94b Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2012194629 Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 26128a80933f4be3bed504d7a2d2785f Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2012194629-project Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.266913 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '73303fae-c87c-4ca8-86ef-f53a66bb47d9'} Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:50:02.268631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. Jul 27 08:50:02.270100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:50:02.271778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] Returning 404 to user: Instance 73303fae-c87c-4ca8-86ef-f53a66bb47d9 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:50:02.271778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-28de3f0f-5b70-4f1d-b91e-519dffea1dc2 tempest-AttachVolumeShelveTestJSON-2012194629 tempest-AttachVolumeShelveTestJSON-2012194629-project] 10.222.0.40 "GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9" status: 404 len: 111 microversion: 2.20 time: 0.033389 Jul 27 08:50:02.271778 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 497/992] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Jul 27 08:50:02 2022] GET /compute/v2.1/servers/73303fae-c87c-4ca8-86ef-f53a66bb47d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:50:13.069909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b855f88a-0340-461f-8e53-f9cc7a470c49 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f55b4040>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:13.077963 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=5 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:13.118073 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b855f88a-0340-461f-8e53-f9cc7a470c49 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/bcdc3f60-c3fd-4e8d-8542-99c104a8aca0" status: 200 len: 350 microversion: 2.1 time: 0.051954 Jul 27 08:50:13.118777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 496/993] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:50:13 2022] GET /compute/v2.1/os-volumes/bcdc3f60-c3fd-4e8d-8542-99c104a8aca0 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:14.922668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2f1b923c-ce8d-44e3-bf04-b89fb6946a7d tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0cc8040>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:14.930455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=37 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:14.972367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2f1b923c-ce8d-44e3-bf04-b89fb6946a7d tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/660ae4b7-3643-4158-bc7b-5b6522cf47aa" status: 200 len: 350 microversion: 2.1 time: 0.053384 Jul 27 08:50:14.973052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 498/994] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:50:14 2022] GET /compute/v2.1/os-volumes/660ae4b7-3643-4158-bc7b-5b6522cf47aa => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:17.828059 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-cfc6b75c-ce53-48bb-9b24-c73e06877471 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f16bd160>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:17.875352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-cfc6b75c-ce53-48bb-9b24-c73e06877471 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/74afbef6-bee9-4955-8cc5-a89b8317dc00" status: 200 len: 351 microversion: 2.1 time: 0.051744 Jul 27 08:50:17.876886 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 497/995] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Jul 27 08:50:17 2022] GET /compute/v2.1/os-volumes/74afbef6-bee9-4955-8cc5-a89b8317dc00 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:17.889097 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d1e40f74-2e29-4fd5-aecc-09ad59563714 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0be9dc0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:17.975432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d1e40f74-2e29-4fd5-aecc-09ad59563714 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090617 Jul 27 08:50:17.976062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 499/996] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Jul 27 08:50:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:17.989672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-eae665c2-0191-43fe-83d0-eaf9851d169f tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0ae0940>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.073125 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-eae665c2-0191-43fe-83d0-eaf9851d169f tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087098 Jul 27 08:50:18.073693 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 498/997] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Jul 27 08:50:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:18.087476 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6b03a104-b4f8-4532-9109-8b7f3f9e0136 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0af5280>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.324725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6b03a104-b4f8-4532-9109-8b7f3f9e0136 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.240927 Jul 27 08:50:18.325321 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 500/998] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:18.337933 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f62d7a18-a605-4a98-896c-5519bbefc592 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f14743a0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.427906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f62d7a18-a605-4a98-896c-5519bbefc592 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093691 Jul 27 08:50:18.428469 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 499/999] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:50:18.441550 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c7532be8-eb47-4d11-a274-7ff57ca0fb7c tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0d09b80>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.538513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c7532be8-eb47-4d11-a274-7ff57ca0fb7c tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098001 Jul 27 08:50:18.538513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 501/1000] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:18.549353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9ac78a9a-af6f-4c8a-b0f0-545ca4976fc3 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f1480af0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.639897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9ac78a9a-af6f-4c8a-b0f0-545ca4976fc3 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085874 Jul 27 08:50:18.639897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 500/1001] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:18.653919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-7b73a7f8-de22-4b5e-8203-8c8801cefa28 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0d2eaf0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.738969 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-7b73a7f8-de22-4b5e-8203-8c8801cefa28 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088901 Jul 27 08:50:18.739538 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 502/1002] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:50:18.753092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-67b3d3da-c38a-4161-8239-0b2151b70d91 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] Calling method '.version_select at 0x7f78f0ae0ee0>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:50:18.835036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-67b3d3da-c38a-4161-8239-0b2151b70d91 tempest-VolumesTestJSON-349084733 tempest-VolumesTestJSON-349084733-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086562 Jul 27 08:50:18.840589 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 501/1003] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Jul 27 08:50:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:33.883724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:34.057936 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-24c9f2f7-ede9-413a-9987-b579aa354f0a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Action: 'create', calling method: .version_select at 0x7f78f0c1b4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-403744077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0Ku7Y1fLm/9dwvqPYPV2vaDpKNSSBhmsIhRCU6rj0Jn2JHxpz7CeEVp5l8oYHUfgH3GgYhI8YWtFuaPYgNFy8FkCfvKwxln2icJIg8YS+sYJGOV/zk66PlDgzOve91jQ=="}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:50:34.075237 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-24c9f2f7-ede9-413a-9987-b579aa354f0a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:50:34.079831 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-24c9f2f7-ede9-413a-9987-b579aa354f0a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for user 3023e29a392a4d97acbb11faecc0c9b8 and project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'key_pairs'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:50:34.149056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-24c9f2f7-ede9-413a-9987-b579aa354f0a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.266764 Jul 27 08:50:34.149970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 503/1004] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Jul 27 08:50:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:51:18.345255 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:51:18.348449 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 08:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:51:22.317347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=5 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.321875 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:22.322396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:22.327590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=4 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.328469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.332940 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-9f0888ef-9bde-4fc7-a116-445c0f6a418a req-bca47c3a-e929-47a4-93aa-708349abe5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:22.341998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:22.342477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:22.343691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:22.344133 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:22.348528 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9f0888ef-9bde-4fc7-a116-445c0f6a418a req-bca47c3a-e929-47a4-93aa-708349abe5cb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:22.348958 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-9f0888ef-9bde-4fc7-a116-445c0f6a418a req-bca47c3a-e929-47a4-93aa-708349abe5cb service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:22.361463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-9f0888ef-9bde-4fc7-a116-445c0f6a418a req-bca47c3a-e929-47a4-93aa-708349abe5cb service nova] Creating event network-changed:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:51:22.367723 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-9f0888ef-9bde-4fc7-a116-445c0f6a418a req-bca47c3a-e929-47a4-93aa-708349abe5cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041360 Jul 27 08:51:22.368626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 504/1005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:51:22.376325 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:51:22.625910 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3e94a489-85e0-4efd-8f97-8536f2da12cb tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 204 len: 0 microversion: 2.1 time: 0.310201 Jul 27 08:51:22.626557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 502/1006] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:51:22 2022] DELETE /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:22.636148 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:22.636844 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:22.644979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:22.645423 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:22.646234 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:22.646670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:22.787179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:22.794834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ce862c8b-6484-4b3c-88b7-f102584963cc tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.163020 Jul 27 08:51:22.795560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 505/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:22 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:51:23.818473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:23.819119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:23.825686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:23.826724 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:23.827668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:23.828127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:23.965676 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:23.973690 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1f936c39-609a-43ca-b72b-2d0f968a4d3c tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.160212 Jul 27 08:51:23.974404 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 503/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:23 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:24.996459 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:24.997111 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:25.004338 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:25.005045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:25.005992 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:25.006628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:25.246905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:25.260289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e314a2a3-4fb4-4a13-bd06-44bcf2c5452f tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1569 microversion: 2.1 time: 0.267556 Jul 27 08:51:25.261415 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 506/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:24 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:25.445887 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-813394186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-403744077", "security_groups": [{"name": "tempest-secgroup-smoke-2103532908"}], "block_device_mapping_v2": [{"uuid": "8d6d87d9-3d0e-422f-b480-b0e000ae196d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ecada7fa-7a56-41f5-bba0-0e680e111c5d"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:25.571986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] validate_networks() for [('ecada7fa-7a56-41f5-bba0-0e680e111c5d', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:51:25.807870 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-0cc7b9b2-4d25-4f1a-81ad-2df0546e00b9 req-f082c0c0-06ee-4022-a06a-d867c01adc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b", "name": "network-vif-deleted", "tag": "5a802d95-999c-4c8e-9c81-861429f0b5f0"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:25.817876 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0cc7b9b2-4d25-4f1a-81ad-2df0546e00b9 req-f082c0c0-06ee-4022-a06a-d867c01adc96 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:25.818382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0cc7b9b2-4d25-4f1a-81ad-2df0546e00b9 req-f082c0c0-06ee-4022-a06a-d867c01adc96 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:25.833048 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-0cc7b9b2-4d25-4f1a-81ad-2df0546e00b9 req-f082c0c0-06ee-4022-a06a-d867c01adc96 service nova] Creating event network-vif-deleted:5a802d95-999c-4c8e-9c81-861429f0b5f0 for instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b on hv-cinder-85117 Jul 27 08:51:25.841089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-0cc7b9b2-4d25-4f1a-81ad-2df0546e00b9 req-f082c0c0-06ee-4022-a06a-d867c01adc96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176536 Jul 27 08:51:25.841089 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 507/1010] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:51:26.285712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:26.286668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:26.293999 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:26.294497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:26.295295 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:26.295877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:26.371342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:51:26.372038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:51:26.372796 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:51:26.372955 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b63aaa3a9db4fa4b50bf93eae5a1ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d10772d974f47d7bc82c0f0b8a8facf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:26.373447 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:51:26.374038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:51:26.384399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:26.385126 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:26.389720 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-abbad78e-2f9c-4c66-a005-6f965743b85a tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 200 len: 1219 microversion: 2.1 time: 0.106596 Jul 27 08:51:26.389952 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:26.390056 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 508/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:26 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:51:26.390175 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:26.411859 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:51:26.416502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for user 3023e29a392a4d97acbb11faecc0c9b8 and project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:51:26.506897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:51:26.509002 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d6d87d9-3d0e-422f-b480-b0e000ae196d',volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:51:26.901575 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e1b3d784-9b5b-478d-8edc-94783e7b74cd tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.459827 Jul 27 08:51:26.902352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 504/1012] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 08:51:26.913875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4d701875-ffed-4f58-82f4-545cf46a0e0f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:26.914572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4d701875-ffed-4f58-82f4-545cf46a0e0f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:26.969638 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4d701875-ffed-4f58-82f4-545cf46a0e0f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:26.976848 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4d701875-ffed-4f58-82f4-545cf46a0e0f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1093 microversion: 2.1 time: 0.066754 Jul 27 08:51:26.977499 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 509/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:26 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:27.410352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:27.411941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] [instance: 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:27.417143 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:27.417606 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:27.418405 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:27.418850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:27.433260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] HTTP exception thrown: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Request method failure captured: Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b HTTP/1.1 Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PspgYbvUDYoWBVgc8DH7keq40ePW_-gfnX7cBjq4YlGo8l5EOQzMl8EV6aN2thsWeFV37wo0ob2uwMFUKyNm0ixhN2UOk9eSlSMsU5ZjBl5ZwwWnOTmHTrsICzkjiGSKRcV_FcIEydcX6EV8LLddrp8jr1r7sJPH0nJc-cE2VNGd9U Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 5d10772d974f47d7bc82c0f0b8a8facf Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-TestShelveInstance-854319889 Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:51:27.435032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d10772d974f47d7bc82c0f0b8a8facf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5d10772d974f47d7bc82c0f0b8a8facf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5d10772d974f47d7bc82c0f0b8a8facf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5d10772d974f47d7bc82c0f0b8a8facf", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-TestShelveInstance-854319889 Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 5d10772d974f47d7bc82c0f0b8a8facf Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-TestShelveInstance-854319889 Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-TestShelveInstance-854319889-project Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 7b63aaa3a9db4fa4b50bf93eae5a1ffc Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-TestShelveInstance-854319889-project Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. Jul 27 08:51:27.442128 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b'} Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:51:27.443737 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. Jul 27 08:51:27.445361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:51:27.446841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Returning 404 to user: Instance 64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:51:27.446841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-57a8693e-3618-4a84-a15d-c7451c7426ce tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b" status: 404 len: 111 microversion: 2.1 time: 0.031175 Jul 27 08:51:27.446841 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 505/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:27 2022] GET /compute/v2.1/servers/64ec7762-d0bf-4cea-8fc2-b4c9fcd5e67b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:51:27.695976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0da1da8b-1443-4c77-b4cf-28107661ea21 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] Calling method '.version_select at 0x7f78f0c113a0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:27.776233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0da1da8b-1443-4c77-b4cf-28107661ea21 tempest-TestShelveInstance-854319889 tempest-TestShelveInstance-854319889-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1955969943" status: 202 len: 0 microversion: 2.1 time: 0.084852 Jul 27 08:51:27.777038 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 510/1015] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Jul 27 08:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1955969943 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:51:27.997119 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a753c999-ab06-4754-9bbe-72f1dfb4bb94 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:27.997801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a753c999-ab06-4754-9bbe-72f1dfb4bb94 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:28.074072 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a753c999-ab06-4754-9bbe-72f1dfb4bb94 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:28.082840 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a753c999-ab06-4754-9bbe-72f1dfb4bb94 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1093 microversion: 2.1 time: 0.089736 Jul 27 08:51:28.083397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 506/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:27 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:29.103712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:29.104352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:29.111882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:29.112595 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:29.113551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:29.114168 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:29.207930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:29.218733 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b9b4e12e-5a73-4a4a-bda7-ba0eafa2ebc1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1191 microversion: 2.1 time: 0.115983 Jul 27 08:51:29.220006 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 511/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:29 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:30.247295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:30.256880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:30.281234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:30.283050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:30.286421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:30.286421 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:30.590715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:30.601995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fd8f0f3d-a2b8-4520-9d8c-a3239d6d431b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1209 microversion: 2.1 time: 0.362843 Jul 27 08:51:30.603745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 507/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:30 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1209 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:31.623836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:31.624523 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:31.630795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:31.631458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:31.634092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:31.634092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:31.841898 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:31.850919 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c754ca7b-3ab2-4a60-815e-0e4b5ae7fef2 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1277 microversion: 2.1 time: 0.230857 Jul 27 08:51:31.851707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 512/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:31 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:32.422359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-0d5f3535-4fb7-41b1-878d-40ab6336f10f req-5d2037c9-9d63-49e6-9e1e-ddb882e864d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c216ccb-efc3-469c-b23e-31364c82cb45", "tag": "0c459acb-240d-4861-a242-e9dc42994183"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:32.448743 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-0d5f3535-4fb7-41b1-878d-40ab6336f10f req-5d2037c9-9d63-49e6-9e1e-ddb882e864d9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:32.449200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-0d5f3535-4fb7-41b1-878d-40ab6336f10f req-5d2037c9-9d63-49e6-9e1e-ddb882e864d9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:32.483241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-0d5f3535-4fb7-41b1-878d-40ab6336f10f req-5d2037c9-9d63-49e6-9e1e-ddb882e864d9 service nova] Creating event network-changed:0c459acb-240d-4861-a242-e9dc42994183 for instance 4c216ccb-efc3-469c-b23e-31364c82cb45 on hv-cinder-85117 Jul 27 08:51:32.497906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-0d5f3535-4fb7-41b1-878d-40ab6336f10f req-5d2037c9-9d63-49e6-9e1e-ddb882e864d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081594 Jul 27 08:51:32.519071 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 508/1020] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:51:32.873583 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:32.874966 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:32.883198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:32.884905 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:32.887563 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:32.888412 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:33.176105 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:33.183708 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4ba85da1-79de-4524-982e-8aad66dbf3d7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.314448 Jul 27 08:51:33.184626 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 513/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:32 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:34.206944 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:34.207642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:34.213943 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:34.214431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:34.215205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:34.215642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:34.460383 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:34.471857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4b7c6257-3f0d-46ed-9039-5685680af5ed tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.270037 Jul 27 08:51:34.472419 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 509/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:34 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:35.492842 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:35.493560 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:35.499870 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:35.500318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:35.501092 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:35.501529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:35.673759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:35.681724 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-358d3d3b-452a-438c-89d2-c4562a9d90bc tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.192735 Jul 27 08:51:35.682305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 514/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:35 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:51:36.705613 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:36.706273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:36.709846 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.714242 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:36.714765 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:36.715773 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:36.716570 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:36.888528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:36.896567 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-64a1a94d-1b70-4f23-b3ab-1f40324bb114 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.195191 Jul 27 08:51:36.897154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 510/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:36 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:37.919437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:37.919437 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:37.924503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:37.937023 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:37.938075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:37.940601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:37.941347 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:38.107921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:38.112343 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-383f12c3-4a46-43c9-bdce-fd933b590ccf tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.198613 Jul 27 08:51:38.112921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 515/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:37 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:39.133093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:39.133705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:39.136044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=8 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:39.141029 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:39.141487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:39.142593 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:39.143205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:39.285060 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:39.292776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8bc7b309-006f-4290-a9df-f62b401af1e4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.163652 Jul 27 08:51:39.293344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 511/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:39 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:40.314451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:40.315160 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:40.321754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:40.322232 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:40.323005 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:40.323441 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:40.467451 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:40.476182 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bc576edf-6bf6-4b27-bef5-15d6e47f0fa3 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.166270 Jul 27 08:51:40.476747 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 516/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:40 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:41.498378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:41.499090 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:41.506007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:41.506502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:41.507282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:41.507720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:41.665045 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:41.673478 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-79afae1e-7cf8-484c-93c0-2486ac4329c7 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.178437 Jul 27 08:51:41.674048 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 512/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:41 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:42.695725 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:42.696398 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:42.703022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:42.703483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:42.705140 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:42.705582 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:42.837679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:42.845811 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-dbc9aca5-ff8d-4572-9941-fbb16a3b125e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.154666 Jul 27 08:51:42.846393 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 517/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:42 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:43.866369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:43.866985 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:43.873738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:43.874359 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:43.875138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:43.875579 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:44.013627 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:44.021953 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9d2ec495-9976-448e-b4c2-fabc795c525b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.159377 Jul 27 08:51:44.022557 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 513/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:43 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:51:45.043668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:45.044233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:45.050952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:45.051400 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:45.052243 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:45.052678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:45.184191 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:45.193258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-494ee376-3c36-47a7-8640-c719bfede18f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.153553 Jul 27 08:51:45.194198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 518/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:45 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:46.215185 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:46.215749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:46.223564 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:46.224148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:46.224934 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:46.225395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:46.368208 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:46.378618 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ee66a193-31e2-4e84-8f0d-fb8422ffb0de tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.167263 Jul 27 08:51:46.379203 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 514/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:46 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:47.401142 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:47.401759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:47.408813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:47.409262 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:47.410032 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:47.410515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:47.549971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:47.558661 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5a5aa48f-326b-4889-8b46-385977df2de4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.161361 Jul 27 08:51:47.559329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 519/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:47 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:47.876784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-472b0523-7c89-4e18-b839-6706c40ffb6e req-66605a24-4c4c-49ee-84ba-da1fb345ac7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c216ccb-efc3-469c-b23e-31364c82cb45", "name": "network-vif-plugged", "status": "completed", "tag": "0c459acb-240d-4861-a242-e9dc42994183"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:47.886463 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-472b0523-7c89-4e18-b839-6706c40ffb6e req-66605a24-4c4c-49ee-84ba-da1fb345ac7f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:47.891362 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-472b0523-7c89-4e18-b839-6706c40ffb6e req-66605a24-4c4c-49ee-84ba-da1fb345ac7f service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:47.898390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-472b0523-7c89-4e18-b839-6706c40ffb6e req-66605a24-4c4c-49ee-84ba-da1fb345ac7f service nova] Creating event network-vif-plugged:0c459acb-240d-4861-a242-e9dc42994183 for instance 4c216ccb-efc3-469c-b23e-31364c82cb45 on hv-cinder-85117 Jul 27 08:51:47.903602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-472b0523-7c89-4e18-b839-6706c40ffb6e req-66605a24-4c4c-49ee-84ba-da1fb345ac7f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150252 Jul 27 08:51:47.904277 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 515/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:51:48.580466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:48.581072 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:48.587912 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:48.600479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:48.600479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:48.600479 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:48.986531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:48.994498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-08449af8-c416-430a-a7e6-062ab26ea6e1 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.419149 Jul 27 08:51:48.995080 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 520/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:48 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:50.018116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:50.018850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:50.025424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:50.025951 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:50.026860 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:50.027501 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:50.169023 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:50.176757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-30f2fca8-31e4-4420-a1a6-e5050fcfea51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1265 microversion: 2.1 time: 0.164264 Jul 27 08:51:50.177324 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 516/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:50 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:51.197939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:51.198612 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:51.206012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:51.206483 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:51.207241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:51.207669 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:51.341195 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:51.350529 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8579bf18-64a8-4476-96ba-2b6ecf8d1aec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1451 microversion: 2.1 time: 0.156404 Jul 27 08:51:51.351098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 521/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:51 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:51.380176 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:51:51.380776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:51:51.387295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:51.387741 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:51.388499 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:51.388929 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:51.523881 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:51:51.531861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-42b146d1-779e-4511-be46-cf7e326ad645 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1451 microversion: 2.1 time: 0.155995 Jul 27 08:51:51.532452 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 517/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:51:51 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:51:53.552675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-19f3b50f-742e-468b-949b-b8e0cee92641 req-db4411c3-8946-46ad-8551-280d7ee77bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c216ccb-efc3-469c-b23e-31364c82cb45", "tag": "0c459acb-240d-4861-a242-e9dc42994183"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:51:53.558762 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:53.564607 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-19f3b50f-742e-468b-949b-b8e0cee92641 req-db4411c3-8946-46ad-8551-280d7ee77bfe service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:51:53.565307 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-19f3b50f-742e-468b-949b-b8e0cee92641 req-db4411c3-8946-46ad-8551-280d7ee77bfe service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:51:53.569512 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=89 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:53.577806 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-19f3b50f-742e-468b-949b-b8e0cee92641 req-db4411c3-8946-46ad-8551-280d7ee77bfe service nova] Creating event network-changed:0c459acb-240d-4861-a242-e9dc42994183 for instance 4c216ccb-efc3-469c-b23e-31364c82cb45 on hv-cinder-85117 Jul 27 08:51:53.583740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-19f3b50f-742e-468b-949b-b8e0cee92641 req-db4411c3-8946-46ad-8551-280d7ee77bfe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 Jul 27 08:51:53.584526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 522/1039] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:52:23.641364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2024782881", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452"}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:52:23.648788 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:23.649640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:23.695991 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] validate_networks() for None {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:52:24.223674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:52:24.224094 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:52:24.224563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:52:24.224971 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:52:24.225385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:52:24.234426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:24.234879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:24.235684 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:24.236117 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:24.252948 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Getting quotas for project 23200086cd3246318074e7eafa118e58. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:52:24.257120 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Getting quotas for user c9a0f644e9794e51b843952b3552cd22 and project 23200086cd3246318074e7eafa118e58. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:52:24.269318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:52:24.271603 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:52:24.433133 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b16acda5-dcb1-4d28-9dde-d3515c2ea195 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796683 Jul 27 08:52:24.433829 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 518/1040] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:52:24.446045 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d5083205-6ee7-4a85-8113-37636bfaea61 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:24.446979 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d5083205-6ee7-4a85-8113-37636bfaea61 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:24.505090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d5083205-6ee7-4a85-8113-37636bfaea61 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:24.512836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d5083205-6ee7-4a85-8113-37636bfaea61 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1215 microversion: 2.1 time: 0.071811 Jul 27 08:52:24.514272 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 523/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:24 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:25.534388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-529f708b-c7e3-4ec1-852c-aa5941d545b5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:25.534940 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-529f708b-c7e3-4ec1-852c-aa5941d545b5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:25.590347 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-529f708b-c7e3-4ec1-852c-aa5941d545b5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:25.597563 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-529f708b-c7e3-4ec1-852c-aa5941d545b5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1215 microversion: 2.1 time: 0.067953 Jul 27 08:52:25.598112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 519/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:25 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:26.619055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:26.619668 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:26.627688 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:26.628164 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:26.629498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:26.629498 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:26.692083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:26.699848 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b5a95295-ba5c-44c6-8c9e-b5c24cc3df98 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1267 microversion: 2.1 time: 0.085107 Jul 27 08:52:26.700407 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 524/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:26 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:27.723287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:27.723882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:27.730648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:27.731099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:27.731867 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:27.732317 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:27.795967 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:27.804695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a07ac652-281b-4df6-b11e-66f1e30829e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1273 microversion: 2.1 time: 0.085421 Jul 27 08:52:27.808459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 520/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:27 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:28.829035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:28.829736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:28.836254 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:28.836710 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:28.837452 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:28.837881 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:29.067620 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:29.075002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-007ed72f-3b26-48c0-a35e-39f0a704b808 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.250628 Jul 27 08:52:29.075583 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 525/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:28 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:29.320200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-1a8e55af-1ca4-443f-ac82-45374b53b063 req-7aac2ba8-9e22-424c-8644-532fb5b5f7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d1991a-3720-4e83-ae55-57c58c34cfc0", "tag": "98b0e537-ccb9-41ed-b974-add106db1696"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:52:29.331038 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-1a8e55af-1ca4-443f-ac82-45374b53b063 req-7aac2ba8-9e22-424c-8644-532fb5b5f7e4 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:29.331902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-1a8e55af-1ca4-443f-ac82-45374b53b063 req-7aac2ba8-9e22-424c-8644-532fb5b5f7e4 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:29.352639 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-1a8e55af-1ca4-443f-ac82-45374b53b063 req-7aac2ba8-9e22-424c-8644-532fb5b5f7e4 service nova] Creating event network-changed:98b0e537-ccb9-41ed-b974-add106db1696 for instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 on hv-cinder-85117 Jul 27 08:52:29.355369 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-1a8e55af-1ca4-443f-ac82-45374b53b063 req-7aac2ba8-9e22-424c-8644-532fb5b5f7e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038876 Jul 27 08:52:29.355965 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 521/1046] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:52:30.097519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:30.098094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:30.104775 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:30.105233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:30.106007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:30.106470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:30.314418 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:30.321970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f1acfa5f-6feb-415e-b452-254506300cb5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.229343 Jul 27 08:52:30.322577 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 526/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:30 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:31.345458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:31.346231 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:31.352503 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:31.352952 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:31.353742 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:31.354203 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:31.489314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:31.496833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-2cab3407-ffa0-4276-b411-4afc5da453c5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.156651 Jul 27 08:52:31.497395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 522/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:31 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:32.519923 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:32.520503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:32.526605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:32.527052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:32.527862 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:32.528303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:32.666515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:32.674130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a235820e-5d05-4a33-a501-a2f0832499e7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.159567 Jul 27 08:52:32.674713 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 527/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:32 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:33.695626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:33.696328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:33.703726 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:33.704234 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:33.705006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:33.705440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:33.839919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:33.848364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-282d54a7-3de8-474c-aa4e-57b9fc195cae tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.156658 Jul 27 08:52:33.848935 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 523/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:33 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:34.870122 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:34.870700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:34.873362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:34.878667 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:34.879117 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:34.881714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:34.881714 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:35.122090 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:35.129606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-18168052-9b2f-4d20-9149-9641208d6851 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.263734 Jul 27 08:52:35.130318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 528/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:34 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:36.152058 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:36.152681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:36.155155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.157162 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=8 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.162582 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:36.163036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:36.164301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:36.164655 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:36.301740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:36.310410 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1b0325ef-c0d6-46c8-bf39-9eac201f8dec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.162800 Jul 27 08:52:36.310987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 524/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:36 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:37.333772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:37.334432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:37.341176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:37.341619 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:37.342444 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:37.342883 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:37.484737 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:37.496230 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-74852b81-ea2f-49a0-b5d1-2ce201ea2a2d tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.166308 Jul 27 08:52:37.497035 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 529/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:37 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:52:38.520225 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:38.520779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:38.527754 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:38.528211 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:38.528967 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:38.529399 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:38.668890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:38.678217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-da6b3d9f-c4d6-43c5-a981-2f1669d91ec4 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.162787 Jul 27 08:52:38.678847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 525/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:38 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:39.700510 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:39.701150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:39.708579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:39.709024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:39.709793 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:39.710252 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:39.850685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:39.858002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-0ff02695-6a1f-4906-a3b8-c6d0aae91f50 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.161361 Jul 27 08:52:39.858587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 530/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:39 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:40.879122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:40.879869 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:40.886416 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:40.886868 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:40.887641 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:40.888074 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:41.032531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:41.040398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e488fcd2-31e7-48c6-a278-8340bb90b3db tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.165460 Jul 27 08:52:41.040981 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 526/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:40 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:41.049623 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-afda25e7-d425-4154-9467-c83604d208a7 req-0abd0790-ead7-41d9-97d4-73a013c522c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d1991a-3720-4e83-ae55-57c58c34cfc0", "name": "network-vif-plugged", "status": "completed", "tag": "98b0e537-ccb9-41ed-b974-add106db1696"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:52:41.061361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-afda25e7-d425-4154-9467-c83604d208a7 req-0abd0790-ead7-41d9-97d4-73a013c522c9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:41.061792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-afda25e7-d425-4154-9467-c83604d208a7 req-0abd0790-ead7-41d9-97d4-73a013c522c9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:41.072964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-afda25e7-d425-4154-9467-c83604d208a7 req-0abd0790-ead7-41d9-97d4-73a013c522c9 service nova] Creating event network-vif-plugged:98b0e537-ccb9-41ed-b974-add106db1696 for instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 on hv-cinder-85117 Jul 27 08:52:41.078284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-afda25e7-d425-4154-9467-c83604d208a7 req-0abd0790-ead7-41d9-97d4-73a013c522c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 Jul 27 08:52:41.079564 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 531/1057] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:52:42.062979 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:42.063646 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:42.070459 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:42.070908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:42.071679 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:42.072116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:42.214554 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:42.223789 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8dcf5a71-16b9-4adc-ab6b-59d962d0aff2 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.164636 Jul 27 08:52:42.224609 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 527/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:42 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:43.248389 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:43.249247 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:43.265964 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:43.266495 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:43.267380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:43.268561 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:43.410243 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:43.418408 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b353e6b0-cb5b-494a-89cb-2decf800db37 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1315 microversion: 2.1 time: 0.174862 Jul 27 08:52:43.418948 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 532/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:43 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:44.444133 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:44.444861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:44.452338 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.452856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:44.453755 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.454321 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:44.595839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:44.603757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ea4a2c5b-5b94-49c8-9f77-cee019455373 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1465 microversion: 2.1 time: 0.164882 Jul 27 08:52:44.604344 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 528/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:44 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:44.649334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:44.649847 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:44.656233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.656675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:44.657436 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.657867 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:44.683487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:52:44.954497 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-73af659e-fbd9-415e-a43e-b56f51cd28ec tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 204 len: 0 microversion: 2.1 time: 0.308656 Jul 27 08:52:44.955088 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 533/1061] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:52:44 2022] DELETE /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:52:44.964454 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:44.969151 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:44.973221 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.973776 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:44.974714 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:44.975236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:45.106897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:45.114640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-de8bfc8a-34b5-4379-8f03-1fa1e29a2e0f tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1471 microversion: 2.1 time: 0.154825 Jul 27 08:52:45.115190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 529/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:44 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:46.136239 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:46.136924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:46.143578 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:46.144052 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:46.144812 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:46.145264 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:46.285647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:46.293443 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c5705d49-96f2-4823-9032-496e11994da7 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1471 microversion: 2.1 time: 0.161400 Jul 27 08:52:46.296466 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 534/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:46 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:47.321476 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:47.322524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:47.341513 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:47.342302 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:47.345122 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:47.346081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:47.371036 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-0fa7f362-dc67-438a-b384-48a692d61c00 req-7ac3e386-1a46-436c-be6d-7643d0fd52bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d1991a-3720-4e83-ae55-57c58c34cfc0", "name": "network-vif-deleted", "tag": "98b0e537-ccb9-41ed-b974-add106db1696"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:52:47.383945 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0fa7f362-dc67-438a-b384-48a692d61c00 req-7ac3e386-1a46-436c-be6d-7643d0fd52bd service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:47.384462 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-0fa7f362-dc67-438a-b384-48a692d61c00 req-7ac3e386-1a46-436c-be6d-7643d0fd52bd service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:47.397728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-0fa7f362-dc67-438a-b384-48a692d61c00 req-7ac3e386-1a46-436c-be6d-7643d0fd52bd service nova] Creating event network-vif-deleted:98b0e537-ccb9-41ed-b974-add106db1696 for instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 on hv-cinder-85117 Jul 27 08:52:47.404255 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-0fa7f362-dc67-438a-b384-48a692d61c00 req-7ac3e386-1a46-436c-be6d-7643d0fd52bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038841 Jul 27 08:52:47.409146 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 535/1064] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:52:47.438908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:47.448108 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3367394d-4f04-4c2b-8d38-7680fa072871 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1429 microversion: 2.1 time: 0.132130 Jul 27 08:52:47.449000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 530/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:47 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:48.474305 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:48.474997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:48.481353 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:48.481974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:48.482741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:48.483179 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:48.521855 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:48.522426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:48.522926 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lazy-loading 'fault' on Instance uuid 79d1991a-3720-4e83-ae55-57c58c34cfc0 {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:52:48.571653 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a0f644e9794e51b843952b3552cd22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23200086cd3246318074e7eafa118e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:52:48.579468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b6d1a1c4-e8d0-43fa-861f-19e79dc944a5 tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 200 len: 1305 microversion: 2.1 time: 0.110723 Jul 27 08:52:48.580061 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 536/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:48 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:52:49.601303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:52:49.601912 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] [instance: 79d1991a-3720-4e83-ae55-57c58c34cfc0] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:52:49.609413 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:49.609900 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:49.610908 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:52:49.611393 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:52:49.626866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] HTTP exception thrown: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Request method failure captured: Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 HTTP/1.1 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PzEbGqkzK_VG4iyejy8bzDL_p7q1sSjuxie24i3IMDAeUEigm6itsPURyMIKrGBaV3AJI-ltR80wQELdfe9cFQW1zxr2_ffks7kWi80NKv9YqHq-IZwwldxJ-hLuevum4kVMuCYEKRWE8K8zILOVsBTp1yVZF24fKnRvDPbnL_jeSU Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: 23200086cd3246318074e7eafa118e58 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-VolumesNegativeTest-1056753893 Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:52:49.629300 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23200086cd3246318074e7eafa118e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/23200086cd3246318074e7eafa118e58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/23200086cd3246318074e7eafa118e58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_23200086cd3246318074e7eafa118e58", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-VolumesNegativeTest-1056753893 Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: 23200086cd3246318074e7eafa118e58 Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-VolumesNegativeTest-1056753893 Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-VolumesNegativeTest-1056753893-project Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: c9a0f644e9794e51b843952b3552cd22 Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-VolumesNegativeTest-1056753893-project Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. Jul 27 08:52:49.630896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '79d1991a-3720-4e83-ae55-57c58c34cfc0'} Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:52:49.637341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. Jul 27 08:52:49.640193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:52:49.641720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] Returning 404 to user: Instance 79d1991a-3720-4e83-ae55-57c58c34cfc0 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:52:49.641720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8d294bc1-d801-4d2b-893c-762a8026462b tempest-VolumesNegativeTest-1056753893 tempest-VolumesNegativeTest-1056753893-project] 10.222.0.40 "GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0" status: 404 len: 111 microversion: 2.1 time: 0.033784 Jul 27 08:52:49.641720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 531/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:52:49 2022] GET /compute/v2.1/servers/79d1991a-3720-4e83-ae55-57c58c34cfc0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:53:02.734011 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1508605833", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "networks": [{"uuid": "2be418e3-97cc-46e3-b27f-ccb8f3176ec8"}]}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:53:02.743401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:02.743989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:02.796219 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] validate_networks() for [('2be418e3-97cc-46e3-b27f-ccb8f3176ec8', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:53:03.332997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:53:03.332997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:53:03.332997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:53:03.332997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:53:03.332997 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:53:03.337854 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:03.338426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:03.339236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:03.339683 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:03.358736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Getting quotas for project d79bf8b3761f48c79c09b2cf28a00ba1. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:53:03.362860 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Getting quotas for user 059172e7a08e486d9f1243b82259f10d and project d79bf8b3761f48c79c09b2cf28a00ba1. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:53:03.375248 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:53:03.377551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:53:03.501487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b155e419-c427-463d-b79d-a6b303ec520e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771357 Jul 27 08:53:03.502355 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 537/1068] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:53:03.514093 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9db8244c-da53-4b96-b461-dae80b776943 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:03.514794 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9db8244c-da53-4b96-b461-dae80b776943 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:03.520296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:03.521597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=66 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:03.587077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9db8244c-da53-4b96-b461-dae80b776943 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:03.594718 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9db8244c-da53-4b96-b461-dae80b776943 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1219 microversion: 2.1 time: 0.084419 Jul 27 08:53:03.599237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 532/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:03 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:04.616614 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-11372bc4-6e17-4c17-866f-ad3bc37ba632 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:04.617221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-11372bc4-6e17-4c17-866f-ad3bc37ba632 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:04.672002 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-11372bc4-6e17-4c17-866f-ad3bc37ba632 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:04.678892 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-11372bc4-6e17-4c17-866f-ad3bc37ba632 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1219 microversion: 2.1 time: 0.067073 Jul 27 08:53:04.679458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 538/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:04 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:05.699186 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:05.699926 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:05.708396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:05.708852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:05.709633 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:05.710680 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:05.774113 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:05.782020 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-58ef441b-23fc-4c80-a0c9-3df7666c27c3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1271 microversion: 2.1 time: 0.086823 Jul 27 08:53:05.782616 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 533/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:05 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:53:06.804378 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:06.805176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:06.812297 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:06.812745 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:06.813503 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:06.813937 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:07.030189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:07.038813 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-f2d5c579-df78-4aa3-8efc-14318b3cae55 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.238282 Jul 27 08:53:07.039858 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 539/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:06 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:07.948330 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-1d64e932-b382-4e43-8109-a7fe7f8d6935 req-30d55d1c-1793-490d-9358-5c6d381aef2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e3fffc-810e-4200-8119-1bfd76664166", "tag": "c0704e0d-782b-417d-8fe6-59f0eaac4628"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:53:07.958551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-1d64e932-b382-4e43-8109-a7fe7f8d6935 req-30d55d1c-1793-490d-9358-5c6d381aef2a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:07.959001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-1d64e932-b382-4e43-8109-a7fe7f8d6935 req-30d55d1c-1793-490d-9358-5c6d381aef2a service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:07.972346 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-1d64e932-b382-4e43-8109-a7fe7f8d6935 req-30d55d1c-1793-490d-9358-5c6d381aef2a service nova] Creating event network-changed:c0704e0d-782b-417d-8fe6-59f0eaac4628 for instance b4e3fffc-810e-4200-8119-1bfd76664166 on hv-cinder-85117 Jul 27 08:53:07.977525 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-1d64e932-b382-4e43-8109-a7fe7f8d6935 req-30d55d1c-1793-490d-9358-5c6d381aef2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034084 Jul 27 08:53:07.978127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 534/1073] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:53:08.061082 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:08.061700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:08.069034 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:08.069672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:08.070747 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:08.071575 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:08.319805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:08.327401 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-93787425-3ee3-4eef-b239-d63caf6b6e3e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.270406 Jul 27 08:53:08.338167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 540/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:08 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:09.350464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:09.351152 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:09.357825 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:09.358275 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:09.359133 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:09.359571 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:09.491799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:09.499403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-dbe31e8d-836a-408a-b5e3-a2f9e1c6c87f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.154079 Jul 27 08:53:09.499959 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 535/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:09 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:10.522000 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:10.522684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:10.529770 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:10.533570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:10.533570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:10.533570 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:10.667220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:10.674705 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9c450098-8db5-4c06-9934-dcce89da4ea6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.156618 Jul 27 08:53:10.680924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 541/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:10 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:11.695890 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:11.696500 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:11.703351 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:11.703801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:11.704565 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:11.705007 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:11.842293 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:11.850061 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0b90c375-c7b3-4b36-b057-fa2385796c8d tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.158236 Jul 27 08:53:11.850649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 536/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:11 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:12.872611 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:12.873558 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:12.880167 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:12.880651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:12.881896 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:12.882425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:13.034899 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:13.048635 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-dce6588c-3c52-46be-b647-ba1cd5838a38 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.180428 Jul 27 08:53:13.049241 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 542/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:12 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:14.070187 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:14.070781 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:14.073946 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:14.078861 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:14.079310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:14.080085 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:14.080521 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:14.216314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:14.224241 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f9458ce1-9a37-4ba5-8bd1-f454fc1153a3 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.158020 Jul 27 08:53:14.228945 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 537/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:14 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:15.247291 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:15.247932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:15.249900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:15.251075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=8 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:15.255840 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:15.256370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:15.257196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:15.257644 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:15.323145 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-845491ce-23cc-4d00-9204-b63749686b5f req-dfe95bff-7bd4-471b-aab9-7f914c6640ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e3fffc-810e-4200-8119-1bfd76664166", "name": "network-vif-plugged", "status": "completed", "tag": "c0704e0d-782b-417d-8fe6-59f0eaac4628"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:53:15.335453 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-845491ce-23cc-4d00-9204-b63749686b5f req-dfe95bff-7bd4-471b-aab9-7f914c6640ab service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:15.335902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-845491ce-23cc-4d00-9204-b63749686b5f req-dfe95bff-7bd4-471b-aab9-7f914c6640ab service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:15.349091 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-845491ce-23cc-4d00-9204-b63749686b5f req-dfe95bff-7bd4-471b-aab9-7f914c6640ab service nova] Creating event network-vif-plugged:c0704e0d-782b-417d-8fe6-59f0eaac4628 for instance b4e3fffc-810e-4200-8119-1bfd76664166 on hv-cinder-85117 Jul 27 08:53:15.355550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-845491ce-23cc-4d00-9204-b63749686b5f req-dfe95bff-7bd4-471b-aab9-7f914c6640ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Jul 27 08:53:15.356153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 538/1080] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:53:15.397695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:15.406777 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-eefae5a6-2248-4d24-9ebd-ca9c8679e633 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.164172 Jul 27 08:53:15.407431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 543/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:15 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:16.429686 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:16.430440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:16.437269 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:16.437811 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:16.438581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:16.439019 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:16.579102 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:16.586528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-26379f6f-0a0d-4fab-9bbe-d5541005d540 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.161473 Jul 27 08:53:16.589381 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 539/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:16 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:17.608677 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:17.609284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:17.616807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:17.616947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:17.617707 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:17.618471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:17.764007 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:17.773041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6a7db76b-7aa3-4594-9b03-85401a0db71b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.168188 Jul 27 08:53:17.773912 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 544/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:17 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:18.794496 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:18.795101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:18.801739 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:18.802215 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:18.803044 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:18.803487 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:18.939034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:18.946591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5593711c-1ef0-4a79-b865-ad8f620e1381 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.156239 Jul 27 08:53:18.947154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 540/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:18 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:19.969240 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:19.969825 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:19.976840 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:19.977453 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:19.978316 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:19.978759 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:20.133613 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:20.141555 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e72a23aa-5b40-4ee5-b05e-396677718845 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1319 microversion: 2.1 time: 0.177205 Jul 27 08:53:20.142788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 545/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:19 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:53:21.163050 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:53:21.163666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:21.170446 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:21.170897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:21.171664 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:21.172098 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:21.310524 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:53:21.315197 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ed461fd0-47d4-47f5-a31a-7dc9edfdc1c8 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1509 microversion: 2.1 time: 0.156036 Jul 27 08:53:21.315758 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 541/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:53:21 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:53:51.586665 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e82aad2-d004-4439-ac3e-da377c9523e3", "device": "/dev/sdb"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:53:51.589579 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:53:51.591818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:51.592468 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=44 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:51.598432 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:51.598875 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:51.599639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:53:51.600068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:53:52.157837 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-37018a5a-3543-4ff0-bbef-40964638e8e5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "POST /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575150 Jul 27 08:53:52.159042 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 546/1087] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:53:51 2022] POST /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:20.130520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:20.131086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:20.133426 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=22 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:20.134090 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=46 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:20.140017 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:20.146396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:20.146396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:20.146396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:20.230472 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lazy-loading 'services' on Instance uuid b4e3fffc-810e-4200-8119-1bfd76664166 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:54:20.502532 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8853f0dc-b0fb-444d-beab-d75f88b1039b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166/os-volume_attachments/9e82aad2-d004-4439-ac3e-da377c9523e3" status: 202 len: 0 microversion: 2.1 time: 0.375853 Jul 27 08:54:20.503388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 542/1088] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:54:20 2022] DELETE /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166/os-volume_attachments/9e82aad2-d004-4439-ac3e-da377c9523e3 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:54:21.642068 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:21.642869 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:21.647055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:21.647647 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:21.662349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:21.662932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:21.663767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:21.664233 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:21.696284 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:54:22.108300 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-003df6cb-84fc-4bcb-8752-bc17e908a48a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 204 len: 0 microversion: 2.1 time: 0.467456 Jul 27 08:54:22.109150 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 547/1089] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:54:21 2022] DELETE /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:54:22.118235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:22.123515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:22.126394 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:22.126868 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:22.127639 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:22.128109 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:22.270018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:22.281832 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d0277e69-96ef-4947-8f33-2c0201730b2a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1515 microversion: 2.1 time: 0.167511 Jul 27 08:54:22.282364 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 543/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:22 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:23.306692 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:23.307382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:23.314713 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:23.315155 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:23.315917 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:23.316349 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:23.454113 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:23.461906 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a4cdca1b-ccd8-4464-9c20-bb1bd7747554 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1515 microversion: 2.1 time: 0.159458 Jul 27 08:54:23.462551 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 548/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:23 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:24.483977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:24.484583 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:24.491665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:24.492114 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:24.492886 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:24.493318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:24.650031 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:24.664850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-738264ec-86d2-4ac2-91c1-8cf62cd19780 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1515 microversion: 2.1 time: 0.184671 Jul 27 08:54:24.669380 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 544/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:24 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:24.718685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-a03deb9e-49af-4f1c-b897-363bde509e1f req-250fea26-4446-4407-9867-b35a431906c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e3fffc-810e-4200-8119-1bfd76664166", "name": "network-vif-deleted", "tag": "c0704e0d-782b-417d-8fe6-59f0eaac4628"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:24.728309 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a03deb9e-49af-4f1c-b897-363bde509e1f req-250fea26-4446-4407-9867-b35a431906c5 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:24.728741 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-a03deb9e-49af-4f1c-b897-363bde509e1f req-250fea26-4446-4407-9867-b35a431906c5 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:24.743639 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-a03deb9e-49af-4f1c-b897-363bde509e1f req-250fea26-4446-4407-9867-b35a431906c5 service nova] Creating event network-vif-deleted:c0704e0d-782b-417d-8fe6-59f0eaac4628 for instance b4e3fffc-810e-4200-8119-1bfd76664166 on hv-cinder-85117 Jul 27 08:54:24.748950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-a03deb9e-49af-4f1c-b897-363bde509e1f req-250fea26-4446-4407-9867-b35a431906c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Jul 27 08:54:24.749549 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 549/1093] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:25.690791 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:25.691409 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:25.697941 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:25.698422 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:25.699191 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:25.699630 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:25.735562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:25.735930 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:25.736390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lazy-loading 'fault' on Instance uuid b4e3fffc-810e-4200-8119-1bfd76664166 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:54:25.778597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:25.787224 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1cf8530b-9618-414d-bf7f-dd5c0394a45e tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 200 len: 1309 microversion: 2.1 time: 0.100320 Jul 27 08:54:25.787801 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 545/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:25 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:26.808740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:26.809371 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: b4e3fffc-810e-4200-8119-1bfd76664166] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:26.817378 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:26.817820 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:26.818649 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:26.819087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:26.833772 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] HTTP exception thrown: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Request method failure captured: Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 HTTP/1.1 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pzrx6QLaAmrA9tESri30lLOAnkl7_zFFJIoxnPYgYcRgUgKrtgalLfu7pSacVT_Zx-Q_er3XMA556q5Scgq5xk83RPQ39c66cbVE0t863BI5WzuWguW0d-nnFPEtLmTXKof1KhMd2Vx7Y0K0PC8DZBG4u9ciEETAvNmtUIx4Odywow Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: d79bf8b3761f48c79c09b2cf28a00ba1 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:54:26.835471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d79bf8b3761f48c79c09b2cf28a00ba1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: d79bf8b3761f48c79c09b2cf28a00ba1 Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotTestJSON-168933705-project Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 059172e7a08e486d9f1243b82259f10d Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotTestJSON-168933705-project Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. Jul 27 08:54:26.837220 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'b4e3fffc-810e-4200-8119-1bfd76664166'} Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:54:26.838270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. Jul 27 08:54:26.840047 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:26.841671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Returning 404 to user: Instance b4e3fffc-810e-4200-8119-1bfd76664166 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:54:26.841671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1578d3e6-80d7-4293-a074-0d0f940516b9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166" status: 404 len: 111 microversion: 2.1 time: 0.032492 Jul 27 08:54:26.841671 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 550/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:26 2022] GET /compute/v2.1/servers/b4e3fffc-810e-4200-8119-1bfd76664166 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:54:30.534610 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:30.535332 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:30.543464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:30.543906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:30.544698 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:30.545125 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:30.573061 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:54:30.844679 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:54:30.846176 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 08:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:54:30.849948 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-4e3e6048-8b6f-407b-aa70-321e4bfd84ba tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 204 len: 0 microversion: 2.1 time: 0.319410 Jul 27 08:54:30.850612 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 546/1096] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:54:30 2022] DELETE /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:54:30.861161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:30.861785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:30.868590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:30.869041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:30.869827 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:30.870292 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:31.463726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:31.472978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e976ac16-2658-468c-b0c1-a2635521a5fe tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1576 microversion: 2.1 time: 0.616475 Jul 27 08:54:31.473554 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 551/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:30 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1576 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:32.497562 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:32.498310 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:32.505339 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:32.505787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:32.506602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:32.507040 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:32.646184 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:32.654440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6646c9e2-af40-4d58-9bbb-46e8a38df28f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1576 microversion: 2.1 time: 0.161194 Jul 27 08:54:32.657438 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 547/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:32 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:33.676517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:33.677183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:33.684600 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:33.685051 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:33.685861 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:33.686330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:33.760214 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:33.768689 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-05bbba3f-365a-44e2-9925-5e07de9ce15c tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1508 microversion: 2.1 time: 0.096723 Jul 27 08:54:33.769420 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 552/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:33 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1508 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:33.920710 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-5c8b6514-cf9f-4992-8a66-8a3802b16188 req-d7e830c6-035f-406c-9145-0aa56096c595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c216ccb-efc3-469c-b23e-31364c82cb45", "name": "network-vif-deleted", "tag": "0c459acb-240d-4861-a242-e9dc42994183"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:33.932274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5c8b6514-cf9f-4992-8a66-8a3802b16188 req-d7e830c6-035f-406c-9145-0aa56096c595 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:33.932719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-5c8b6514-cf9f-4992-8a66-8a3802b16188 req-d7e830c6-035f-406c-9145-0aa56096c595 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:33.951745 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-5c8b6514-cf9f-4992-8a66-8a3802b16188 req-d7e830c6-035f-406c-9145-0aa56096c595 service nova] Creating event network-vif-deleted:0c459acb-240d-4861-a242-e9dc42994183 for instance 4c216ccb-efc3-469c-b23e-31364c82cb45 on hv-cinder-85117 Jul 27 08:54:33.957473 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-5c8b6514-cf9f-4992-8a66-8a3802b16188 req-d7e830c6-035f-406c-9145-0aa56096c595 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040225 Jul 27 08:54:33.958398 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 548/1100] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:34.792383 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:34.793078 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:34.803367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:34.803828 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:34.804621 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:34.805064 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:34.878740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:34.892091 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d7f97e7d-d3cb-49e5-b367-3ab691297fa6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1508 microversion: 2.1 time: 0.103729 Jul 27 08:54:34.893255 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 553/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:34 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1508 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:35.919844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:35.920546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:35.927511 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:35.927956 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:35.928734 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:35.929170 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:36.062092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:36.070648 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d06dda51-fd09-4f92-a81f-dc7e701a157e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1508 microversion: 2.1 time: 0.155537 Jul 27 08:54:36.071226 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 549/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:35 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:37.091952 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:37.092568 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:37.100245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:37.100732 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:37.101517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:37.101953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:37.166249 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:37.174877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-40408cdd-7bf9-4263-b1d4-7b6a9578e7f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1224 microversion: 2.1 time: 0.086830 Jul 27 08:54:37.175450 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 554/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:37 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:38.196190 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:38.196813 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:38.203728 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:38.204178 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:38.204957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:38.205392 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:38.241250 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:38.241706 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:38.242189 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lazy-loading 'fault' on Instance uuid 4c216ccb-efc3-469c-b23e-31364c82cb45 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:54:38.291475 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:38.300237 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e696ba18-5c5c-4e10-b5ab-dfb22b9848e8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 200 len: 1229 microversion: 2.1 time: 0.108068 Jul 27 08:54:38.300871 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 550/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:38 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:38.460597 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2005462003", "imageRef": "9a219f6a-cbc4-44ac-bc6d-8db79d1af24e", "flavorRef": "452", "networks": [{"uuid": "2be418e3-97cc-46e3-b27f-ccb8f3176ec8"}]}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:38.519118 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.network.neutron [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] validate_networks() for [('2be418e3-97cc-46e3-b27f-ccb8f3176ec8', None, None, None, None, None)] {{(pid=129921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:54:38.883980 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Flavor limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:54:38.884392 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Image limits 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:54:38.884856 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Flavor pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:54:38.885259 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Image pref 0:0:0 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:54:38.885678 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.virt.hardware [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:54:38.895660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:38.896146 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:38.896990 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:38.897425 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:38.915224 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Getting quotas for project d79bf8b3761f48c79c09b2cf28a00ba1. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:54:38.919900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.quota [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Getting quotas for user 059172e7a08e486d9f1243b82259f10d and project d79bf8b3761f48c79c09b2cf28a00ba1. Resources: {'ram', 'cores', 'instances'} {{(pid=129921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:54:38.932196 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Going to run 1 instances... {{(pid=129921) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:54:38.934674 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a219f6a-cbc4-44ac-bc6d-8db79d1af24e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:54:39.062915 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-9333dbb8-d0a4-4f39-9df5-26c261d6b135 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606195 Jul 27 08:54:39.063557 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 555/1105] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:54:39.074804 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-1acd7c28-dfb7-4589-b68b-7eff96276079 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:39.075474 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-1acd7c28-dfb7-4589-b68b-7eff96276079 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:39.133987 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-1acd7c28-dfb7-4589-b68b-7eff96276079 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:39.141753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-1acd7c28-dfb7-4589-b68b-7eff96276079 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1219 microversion: 2.1 time: 0.070887 Jul 27 08:54:39.142441 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 551/1106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:39 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:39.323547 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:39.324170 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:39.332154 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:39.332530 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:39.333377 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:39.333821 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:39.351422 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] HTTP exception thrown: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Request method failure captured: Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 HTTP/1.1 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PxREko5ZpON8G0lPUJb2ruuFPQfmCkimnBOy_rf-fFoEpEkFoL0tMpp5bcDIAkuM-QZogmaH8nqZZpXDESiu2NFgHYSc8_DESEJkn3Loy7Kx1EpaPv2LpXcjmBy0gkTySiG_H-pt1T8AmlRD_LfH6vYcHU5qusIxui7aPonGrDX-Uw Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:54:39.352971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e664288b45ae4b98ae22270ea7eac1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-TestVolumeBootPattern-281247421 Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 3023e29a392a4d97acbb11faecc0c9b8 Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:54:39.354796 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '4c216ccb-efc3-469c-b23e-31364c82cb45'} Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:54:39.356016 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:54:39.357362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:54:39.358554 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Returning 404 to user: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:54:39.358554 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6024f87e-b377-4964-b74e-8811308a72c9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 404 len: 111 microversion: 2.1 time: 0.034912 Jul 27 08:54:39.358554 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 556/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:39 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:54:39.458551 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-517419203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-403744077", "security_groups": [{"name": "tempest-secgroup-smoke-2103532908"}], "block_device_mapping_v2": [{"uuid": "8d6d87d9-3d0e-422f-b480-b0e000ae196d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ecada7fa-7a56-41f5-bba0-0e680e111c5d"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:39.583817 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] validate_networks() for [('ecada7fa-7a56-41f5-bba0-0e680e111c5d', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:54:39.979194 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:54:39.986316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:54:39.986316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:54:39.986316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:54:39.986316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:54:39.990740 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:39.991213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:39.992000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:39.992436 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:40.010251 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:54:40.014296 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for user 3023e29a392a4d97acbb11faecc0c9b8 and project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:54:40.077574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:54:40.080020 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d6d87d9-3d0e-422f-b480-b0e000ae196d',volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:54:40.163109 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:40.163718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:40.170445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:40.176121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:40.176121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:40.176121 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:40.243460 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:40.252286 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-626acae0-72fd-4e0a-b4f8-9f4fc0f75458 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1223 microversion: 2.1 time: 0.093088 Jul 27 08:54:40.252943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 557/1108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:40 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:40.627084 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6d2fcfdf-e299-4bdc-9bfd-e7aaffa12fc8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.174189 Jul 27 08:54:40.633626 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 552/1109] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:54:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:54:40.639109 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-a34e9a68-1ace-42bf-a922-ec005fe97b6f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:40.639651 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-a34e9a68-1ace-42bf-a922-ec005fe97b6f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:40.710882 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-a34e9a68-1ace-42bf-a922-ec005fe97b6f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:40.717701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-a34e9a68-1ace-42bf-a922-ec005fe97b6f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1093 microversion: 2.1 time: 0.082624 Jul 27 08:54:40.718590 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 558/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:40 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:41.274251 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:41.274680 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:41.283330 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:41.283785 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:41.284638 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:41.285134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:41.351411 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:41.360314 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8b8eb4b9-dd61-4a61-859f-6382e54dba37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1271 microversion: 2.1 time: 0.090128 Jul 27 08:54:41.360969 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 553/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:41 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:41.740399 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-85e4dfff-c8e5-497b-8aac-32d9099e5f2a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:41.743553 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-85e4dfff-c8e5-497b-8aac-32d9099e5f2a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:41.793728 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-85e4dfff-c8e5-497b-8aac-32d9099e5f2a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:41.801238 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-85e4dfff-c8e5-497b-8aac-32d9099e5f2a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1093 microversion: 2.1 time: 0.064852 Jul 27 08:54:41.801823 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 559/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:41 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:42.382173 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:42.383599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:42.394969 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:42.395528 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:42.396555 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:42.396976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:42.543480 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:42.552652 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-052b5f6a-4a51-43b8-84f7-c83c9c26563b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.174626 Jul 27 08:54:42.553227 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 554/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:42 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:42.823788 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:42.824527 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:42.832033 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:42.832478 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:42.833368 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:42.833802 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:42.908258 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:42.916106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-78d34160-f9af-45f3-915a-2ac414ba2c8d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1191 microversion: 2.1 time: 0.097078 Jul 27 08:54:42.917003 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 560/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:42 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:43.474662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-d43543db-4a7c-4973-ad95-f53ae5af913e req-ec973207-168c-4cc7-a35f-f91ee5dbbe85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce", "tag": "5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:43.487112 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-d43543db-4a7c-4973-ad95-f53ae5af913e req-ec973207-168c-4cc7-a35f-f91ee5dbbe85 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:43.487695 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-d43543db-4a7c-4973-ad95-f53ae5af913e req-ec973207-168c-4cc7-a35f-f91ee5dbbe85 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:43.501123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-d43543db-4a7c-4973-ad95-f53ae5af913e req-ec973207-168c-4cc7-a35f-f91ee5dbbe85 service nova] Creating event network-changed:5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38 for instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce on hv-cinder-85117 Jul 27 08:54:43.507517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-d43543db-4a7c-4973-ad95-f53ae5af913e req-ec973207-168c-4cc7-a35f-f91ee5dbbe85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036441 Jul 27 08:54:43.507800 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 555/1115] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:43.575071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:43.575685 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:43.583431 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:43.583874 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:43.584754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:43.585186 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:43.828362 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:43.838803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ccd0dc3f-7069-42d7-9bf1-62a802234a81 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.267587 Jul 27 08:54:43.839380 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 561/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:43 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:43.946001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:43.946001 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:43.947947 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:43.948403 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:43.949189 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:43.949629 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:44.035303 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:44.044580 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5877921f-b741-4939-a142-7b0b0b078978 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1209 microversion: 2.1 time: 0.109399 Jul 27 08:54:44.045440 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 556/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:43 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:44.866792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:44.867470 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:44.874040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:44.874624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:44.875484 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:44.875922 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:45.029526 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:45.039496 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5fccee12-853e-4e1c-90fa-966d53d5ca69 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.176475 Jul 27 08:54:45.052496 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 562/1118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:44 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:45.068074 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:45.068691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:45.075936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:45.082596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:45.082596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:45.082596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:45.249179 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:45.257796 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-de19dad5-da07-4b12-ba67-f917fb381126 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1277 microversion: 2.1 time: 0.193538 Jul 27 08:54:45.258404 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 557/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:45 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:45.341726 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-213cc096-1fe6-43e5-844f-1bc068234ee9 req-99bd6ae9-8565-4554-8123-ada3c6de43e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0de859b-72e8-4dc0-9af8-8c63b431ac4e", "tag": "7542cc58-529d-46b1-92a1-0856e0cf8843"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:45.355624 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-213cc096-1fe6-43e5-844f-1bc068234ee9 req-99bd6ae9-8565-4554-8123-ada3c6de43e0 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:45.357160 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-213cc096-1fe6-43e5-844f-1bc068234ee9 req-99bd6ae9-8565-4554-8123-ada3c6de43e0 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:45.371270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-213cc096-1fe6-43e5-844f-1bc068234ee9 req-99bd6ae9-8565-4554-8123-ada3c6de43e0 service nova] Creating event network-changed:7542cc58-529d-46b1-92a1-0856e0cf8843 for instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e on hv-cinder-85117 Jul 27 08:54:45.377426 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-213cc096-1fe6-43e5-844f-1bc068234ee9 req-99bd6ae9-8565-4554-8123-ada3c6de43e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039625 Jul 27 08:54:45.378040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 563/1120] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:46.060902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:46.061508 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:46.068021 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:46.068471 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:46.069253 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:46.069696 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:46.089719 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:46.208482 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:46.216148 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a606423b-de7c-4d87-b422-54f817105e84 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.159082 Jul 27 08:54:46.216723 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 558/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:46 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:46.279869 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:46.280513 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:46.287366 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:46.287809 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:46.288587 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:46.289024 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:46.431766 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:46.440206 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6cfce1e9-5400-4d0a-950c-cc93ff805ee8 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1277 microversion: 2.1 time: 0.165086 Jul 27 08:54:46.440845 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 564/1122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:46 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:47.239292 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:47.239998 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:47.247196 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:47.247644 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:47.248530 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:47.248992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:47.462251 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:47.462893 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:47.470601 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:47.471043 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:47.471815 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:47.472256 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:47.477542 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:47.492200 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e0750655-22f4-4628-a907-01930ee7a4b5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.258712 Jul 27 08:54:47.493153 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 559/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:47 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:47.642970 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:47.651897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5759f6fb-8918-47b1-9f2d-9d5092f61766 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.193436 Jul 27 08:54:47.652816 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 565/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:47 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:48.526677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:48.527305 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:48.534051 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:48.534536 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:48.535307 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:48.535751 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:48.680140 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:48.681303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:48.685779 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:48.695519 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:48.696012 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:48.696807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:48.696990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-8746049a-597b-4f70-a539-5b9dd6462ed5 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.174218 Jul 27 08:54:48.698022 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 560/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:48 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:48.710593 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:48.852115 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:48.860628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b39ca8f1-1557-48d9-a6d4-9fb1da881b96 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.189357 Jul 27 08:54:48.861198 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 566/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:48 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:49.723519 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:49.724134 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:49.730903 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:49.731349 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:49.732118 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:49.732558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:49.882098 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:49.882753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:49.884818 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:49.891585 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:49.892040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:49.893050 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:49.893488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:49.898281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:49.998645 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:50.022396 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=8 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:50.072805 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:50.082645 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6fe17c94-c893-4710-bad0-bb04fca1333d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.204664 Jul 27 08:54:50.083509 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 567/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:49 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:50.110688 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-7034d88c-22aa-461f-8854-9eb6eb19af29 req-1095b9f4-b84e-4d55-a271-63360fe7965c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce", "name": "network-vif-plugged", "status": "completed", "tag": "5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:50.129329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-7034d88c-22aa-461f-8854-9eb6eb19af29 req-1095b9f4-b84e-4d55-a271-63360fe7965c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:50.130059 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-7034d88c-22aa-461f-8854-9eb6eb19af29 req-1095b9f4-b84e-4d55-a271-63360fe7965c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:50.149965 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:50.151236 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-7034d88c-22aa-461f-8854-9eb6eb19af29 req-1095b9f4-b84e-4d55-a271-63360fe7965c service nova] Creating event network-vif-plugged:5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38 for instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce on hv-cinder-85117 Jul 27 08:54:50.159247 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-7034d88c-22aa-461f-8854-9eb6eb19af29 req-1095b9f4-b84e-4d55-a271-63360fe7965c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055483 Jul 27 08:54:50.159602 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-9b1f3652-db30-4219-9b5e-c1127475efa6 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.441125 Jul 27 08:54:50.159869 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 568/1128] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:54:50.160267 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 561/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:49 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:51.106445 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:51.107187 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:51.114100 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:51.114588 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:51.115359 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:51.115801 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:51.190647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:51.191465 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:51.193715 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:51.198668 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:51.199116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:51.199893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:51.200328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:51.256514 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:51.264469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-98b9c566-5c3e-4076-94c8-cf2a208a49ef tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.162723 Jul 27 08:54:51.265664 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 569/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:51 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:51.354174 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:51.362272 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-7378d47e-4e1d-4142-980c-d0707ebeda4f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.175664 Jul 27 08:54:51.362856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 562/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:51 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:52.287070 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:52.287976 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:52.290370 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=10 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:52.291641 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:52.297787 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:52.298606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:52.299845 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:52.300446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:52.384884 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:52.385642 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:52.393287 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:52.393837 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:52.394757 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:52.395266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:52.459094 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:52.466987 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-c85614c4-7527-46d5-9298-beb3e95cc605 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.183668 Jul 27 08:54:52.467596 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 570/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:52 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:52.548104 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:52.557414 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-5ad58e6c-4a1b-4428-8d25-f10032ac9d3f tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1319 microversion: 2.1 time: 0.177141 Jul 27 08:54:52.557992 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 563/1133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:52 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:52.691057 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:54:52.691395 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 08:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:54:53.489872 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:53.490488 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:53.497566 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.498010 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:53.498803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.499628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:53.578976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:53.579590 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:53.586205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.586649 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:53.587430 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.588012 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:53.654531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:53.662978 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-94deedff-546c-4966-ae65-3977a6fdb47e tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.176934 Jul 27 08:54:53.663562 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 571/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:53 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:53.721714 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:53.729328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-db86e6a7-5903-4c35-8830-ab5ebfe301f9 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1508 microversion: 2.1 time: 0.154960 Jul 27 08:54:53.729891 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 564/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:53 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:53.751391 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74ac1d0b-973e-41a0-9598-8bb92a646413", "device": "/dev/sdb"}} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:53.753659 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:53.759690 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.760132 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:53.760891 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:53.761329 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:54.684764 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:54.685375 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:54.693053 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:54.693507 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:54.694401 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:54.694847 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:54.835448 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:54.844084 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3e202a57-e34f-4175-b8e3-6f5e1f02bade tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.162846 Jul 27 08:54:54.847111 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 565/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:54 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:54:55.281941 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-12a05149-732f-4ed2-b13b-05417aeaf157 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "POST /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.534554 Jul 27 08:54:55.282585 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 572/1137] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Jul 27 08:54:53 2022] POST /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce/os-volume_attachments => generated 194 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:55.865749 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:55.866517 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:55.873348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:55.873830 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:55.874632 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:55.875586 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:56.008882 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:56.016855 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f4d17bca-1504-448a-ae33-6558338254c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.154991 Jul 27 08:54:56.017431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 566/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:55 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:57.039630 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:57.040243 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:57.046463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:57.046943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:57.047684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:57.048108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:57.180565 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:57.188152 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-4c5e94cb-7529-4450-bc47-83229492fd9a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.153353 Jul 27 08:54:57.188711 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 573/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:57 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:58.079681 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-e98df15b-c689-466f-925c-dec0bcab805b req-a0ce223f-6cb8-47e0-bf7b-b6d29dcdb81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0de859b-72e8-4dc0-9af8-8c63b431ac4e", "name": "network-vif-plugged", "status": "completed", "tag": "7542cc58-529d-46b1-92a1-0856e0cf8843"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:54:58.089918 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e98df15b-c689-466f-925c-dec0bcab805b req-a0ce223f-6cb8-47e0-bf7b-b6d29dcdb81b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:58.090385 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-e98df15b-c689-466f-925c-dec0bcab805b req-a0ce223f-6cb8-47e0-bf7b-b6d29dcdb81b service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:58.102099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-e98df15b-c689-466f-925c-dec0bcab805b req-a0ce223f-6cb8-47e0-bf7b-b6d29dcdb81b service nova] Creating event network-vif-plugged:7542cc58-529d-46b1-92a1-0856e0cf8843 for instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e on hv-cinder-85117 Jul 27 08:54:58.107340 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-e98df15b-c689-466f-925c-dec0bcab805b req-a0ce223f-6cb8-47e0-bf7b-b6d29dcdb81b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Jul 27 08:54:58.107892 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 567/1140] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:54:58.209017 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:58.210245 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:58.216736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:58.218022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:58.219334 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:58.219780 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:58.359396 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:58.366974 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-5fc37153-a753-4b17-b053-f88277d842f6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.161860 Jul 27 08:54:58.367767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 574/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:58 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:54:59.390130 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:54:59.391284 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:54:59.398432 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:59.398879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:59.399646 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:54:59.400077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:54:59.534505 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:54:59.539677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-889d5b73-4b0c-4229-87b2-ef414533a4c0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1265 microversion: 2.1 time: 0.154454 Jul 27 08:54:59.540257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 568/1142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:54:59 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:00.561807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:00.562605 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:00.569676 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:00.570123 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:00.570930 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:00.571606 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:00.709929 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:00.717932 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6507786e-7c1f-4026-9d6d-b3641455fda4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1452 microversion: 2.1 time: 0.160573 Jul 27 08:55:00.718803 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 575/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:00 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:00.739036 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:00.739647 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:00.746889 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:00.747337 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:00.748099 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:00.748591 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:00.895188 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:00.902784 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-e1194fb2-3ad7-4bf9-af27-e1fed94f6424 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1452 microversion: 2.1 time: 0.167646 Jul 27 08:55:00.903464 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 569/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:00 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:02.951062 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-4ef79a0d-a892-436c-b4e5-e9033c995618 req-4a3f31de-0cd3-4393-ba4d-49accdb48142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0de859b-72e8-4dc0-9af8-8c63b431ac4e", "tag": "7542cc58-529d-46b1-92a1-0856e0cf8843"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:55:02.962505 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4ef79a0d-a892-436c-b4e5-e9033c995618 req-4a3f31de-0cd3-4393-ba4d-49accdb48142 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:02.962949 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-4ef79a0d-a892-436c-b4e5-e9033c995618 req-4a3f31de-0cd3-4393-ba4d-49accdb48142 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:02.974971 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-4ef79a0d-a892-436c-b4e5-e9033c995618 req-4a3f31de-0cd3-4393-ba4d-49accdb48142 service nova] Creating event network-changed:7542cc58-529d-46b1-92a1-0856e0cf8843 for instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e on hv-cinder-85117 Jul 27 08:55:02.980311 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-4ef79a0d-a892-436c-b4e5-e9033c995618 req-4a3f31de-0cd3-4393-ba4d-49accdb48142 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104762 Jul 27 08:55:02.980947 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 576/1145] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:55:19.570707 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:19.571323 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:19.573839 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=15 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:19.574531 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=64 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:19.579491 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:19.587313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:19.587313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:19.587313 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:19.665856 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lazy-loading 'services' on Instance uuid f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:55:19.887866 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ee50214f-9501-4cf1-90ac-30bc9ce79319 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce/os-volume_attachments/74ac1d0b-973e-41a0-9598-8bb92a646413" status: 202 len: 0 microversion: 2.1 time: 0.320948 Jul 27 08:55:19.888462 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 570/1146] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Jul 27 08:55:19 2022] DELETE /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce/os-volume_attachments/74ac1d0b-973e-41a0-9598-8bb92a646413 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:55:22.065517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=13 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:22.066302 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:22.070260 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:22.070836 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:22.077013 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:22.079022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:22.079022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:22.079022 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:22.105210 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Going to try to terminate instance {{(pid=129921) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:55:22.471939 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-6219e4e4-d957-4c53-a705-4feb76454c37 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 204 len: 0 microversion: 2.1 time: 0.407401 Jul 27 08:55:22.472531 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 577/1147] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:55:22 2022] DELETE /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:55:22.482043 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:22.483175 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:22.489809 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:22.490282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:22.491066 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:22.491492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:22.631032 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:22.638976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-475bfa05-10e7-480a-85c2-99dc6203c952 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1514 microversion: 2.1 time: 0.161669 Jul 27 08:55:22.639546 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 571/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:22 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:23.662829 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:23.663517 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:23.670764 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:23.671318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:23.672106 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:23.672543 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:23.811083 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:23.819502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-bca69549-980b-4b72-9d62-285b51f6d808 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1514 microversion: 2.1 time: 0.161464 Jul 27 08:55:23.820075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 578/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:23 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:24.841748 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:24.842273 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:24.850496 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:24.851938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:24.851938 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:24.852280 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:24.937138 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:24.945599 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f43eebd9-3469-448a-a360-110bdb4db748 tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1472 microversion: 2.1 time: 0.107917 Jul 27 08:55:24.946217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 572/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:24 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1472 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:24.988666 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-bd46d215-49de-4d90-acef-fc3f16493961 req-6fc5a167-ebba-4920-a4cc-95b7205f438c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce", "name": "network-vif-deleted", "tag": "5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:55:24.998216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-bd46d215-49de-4d90-acef-fc3f16493961 req-6fc5a167-ebba-4920-a4cc-95b7205f438c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:24.999675 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-bd46d215-49de-4d90-acef-fc3f16493961 req-6fc5a167-ebba-4920-a4cc-95b7205f438c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:25.009625 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-bd46d215-49de-4d90-acef-fc3f16493961 req-6fc5a167-ebba-4920-a4cc-95b7205f438c service nova] Creating event network-vif-deleted:5ecbbfdd-5b91-4d7d-b55e-553bfac4ae38 for instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce on hv-cinder-85117 Jul 27 08:55:25.015149 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-bd46d215-49de-4d90-acef-fc3f16493961 req-6fc5a167-ebba-4920-a4cc-95b7205f438c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030094 Jul 27 08:55:25.015834 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 579/1151] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:55:25.968897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:25.969550 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:25.976738 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:25.981708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:25.981708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:25.981708 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:26.013897 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:26.014370 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:26.014827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lazy-loading 'fault' on Instance uuid f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:55:26.058672 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '059172e7a08e486d9f1243b82259f10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79bf8b3761f48c79c09b2cf28a00ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:55:26.066164 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-a2489b6f-9f39-45d1-8f8a-5cd5d790555a tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 200 len: 1309 microversion: 2.1 time: 0.102145 Jul 27 08:55:26.066741 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 573/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:25 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:55:27.088046 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:55:27.088736 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] [instance: f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:55:27.095545 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:27.095953 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:27.096718 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:55:27.097281 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:55:27.111361 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] HTTP exception thrown: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Request method failure captured: Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce HTTP/1.1 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4Pzrx6QLaAmrA9tESri30lLOAnkl7_zFFJIoxnPYgYcRgUgKrtgalLfu7pSacVT_Zx-Q_er3XMA556q5Scgq5xk83RPQ39c66cbVE0t863BI5WzuWguW0d-nnFPEtLmTXKof1KhMd2Vx7Y0K0PC8DZBG4u9ciEETAvNmtUIx4Odywow Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: d79bf8b3761f48c79c09b2cf28a00ba1 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:55:27.112982 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d79bf8b3761f48c79c09b2cf28a00ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d79bf8b3761f48c79c09b2cf28a00ba1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: d79bf8b3761f48c79c09b2cf28a00ba1 Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-168933705 Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-VolumesSnapshotTestJSON-168933705-project Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 059172e7a08e486d9f1243b82259f10d Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-VolumesSnapshotTestJSON-168933705-project Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. Jul 27 08:55:27.114968 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce'} Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:55:27.116161 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. Jul 27 08:55:27.118333 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:55:27.119887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] Returning 404 to user: Instance f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:55:27.119887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-2cb39788-db5e-434f-b40c-6e0a448da83b tempest-VolumesSnapshotTestJSON-168933705 tempest-VolumesSnapshotTestJSON-168933705-project] 10.222.0.40 "GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jul 27 08:55:27.119887 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 580/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:55:27 2022] GET /compute/v2.1/servers/f1bcf462-b0df-4b6f-a34c-7eb00a91e4ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:57:04.343988 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=10 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:04.344772 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:04.348762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1676737291", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-403744077", "security_groups": [{"name": "tempest-secgroup-smoke-2103532908"}], "block_device_mapping_v2": [{"uuid": "38eb9374-1e24-40fa-b6bf-3421a7e133f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ecada7fa-7a56-41f5-bba0-0e680e111c5d"}]}} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:04.484016 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.network.neutron [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] validate_networks() for [('ecada7fa-7a56-41f5-bba0-0e680e111c5d', None, None, None, None, None)] {{(pid=129924) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:57:04.949286 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:57:04.949746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image limits 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:57:04.950262 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Flavor pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:57:04.950685 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Image pref 0:0:0 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:57:04.951100 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.virt.hardware [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:57:04.961931 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:04.962423 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:04.963240 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:04.963675 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:04.981919 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:57:04.986879 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.quota [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Getting quotas for user 3023e29a392a4d97acbb11faecc0c9b8 and project e664288b45ae4b98ae22270ea7eac1e6. Resources: {'ram', 'cores', 'instances'} {{(pid=129924) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:57:05.052493 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Going to run 1 instances... {{(pid=129924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:57:05.054666 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38eb9374-1e24-40fa-b6bf-3421a7e133f4',volume_size=None,volume_type=None)] {{(pid=129924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:57:05.488916 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3b0398ad-4e4b-4295-b212-a7392fdc54b9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.147137 Jul 27 08:57:05.489596 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 574/1154] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Jul 27 08:57:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:57:05.499071 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:05.502421 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:05.507962 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-d600f351-25c3-43e6-a8f2-62ba18175e77 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:05.508581 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-d600f351-25c3-43e6-a8f2-62ba18175e77 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:05.567701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-d600f351-25c3-43e6-a8f2-62ba18175e77 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:05.577058 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-d600f351-25c3-43e6-a8f2-62ba18175e77 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1094 microversion: 2.1 time: 0.080372 Jul 27 08:57:05.577753 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 581/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:05 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:06.603256 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:06.603895 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:06.611634 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:06.612092 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:06.612895 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:06.613333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:06.678476 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:06.686378 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-deef7d66-39c2-4190-a6e3-02a756a6ed51 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1144 microversion: 2.1 time: 0.087765 Jul 27 08:57:06.687123 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 575/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:06 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:07.710695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:07.711344 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:07.720469 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:07.721041 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:07.721830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:07.722303 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:07.789924 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:07.799382 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-af17f269-b12a-4eb7-ad93-f30c22a6330b tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1192 microversion: 2.1 time: 0.094205 Jul 27 08:57:07.799907 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 582/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:07 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:08.821282 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:08.822995 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:08.830033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:08.830520 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:08.831388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:08.831850 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:09.019205 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:09.027762 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-59f8752b-db1e-4fd7-9882-89938d0e7e95 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1278 microversion: 2.1 time: 0.210401 Jul 27 08:57:09.028611 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 576/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:08 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:09.859019 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-fdcc894b-5bae-4229-ada5-66d1ff073db8 req-4844541a-1cc1-418d-a649-2079898c928c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff87149-f6c9-4853-83a9-85f651545441", "tag": "23c5071b-889a-4075-bf12-2f7ef7f23fef"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:09.876765 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-fdcc894b-5bae-4229-ada5-66d1ff073db8 req-4844541a-1cc1-418d-a649-2079898c928c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:09.877289 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-fdcc894b-5bae-4229-ada5-66d1ff073db8 req-4844541a-1cc1-418d-a649-2079898c928c service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:09.894386 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-fdcc894b-5bae-4229-ada5-66d1ff073db8 req-4844541a-1cc1-418d-a649-2079898c928c service nova] Creating event network-changed:23c5071b-889a-4075-bf12-2f7ef7f23fef for instance bff87149-f6c9-4853-83a9-85f651545441 on hv-cinder-85117 Jul 27 08:57:09.899991 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-fdcc894b-5bae-4229-ada5-66d1ff073db8 req-4844541a-1cc1-418d-a649-2079898c928c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046983 Jul 27 08:57:09.900602 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 583/1159] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:57:10.049539 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:10.050171 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:10.056968 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:10.057581 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:10.058388 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:10.058827 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:10.295880 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:10.304677 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-b3ad68fb-350c-4ad4-932c-d7e92e0f3078 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.259470 Jul 27 08:57:10.305266 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 577/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:10 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:57:11.327826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:11.328791 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:11.339572 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:11.340027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:11.340817 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:11.341381 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:11.478290 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:11.486611 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-b1aa7478-72ab-4496-8fec-3e1394c05938 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.163632 Jul 27 08:57:11.487183 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 584/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:11 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:12.508651 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:12.509906 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:12.517348 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:12.517796 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:12.518750 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:12.519193 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:12.650041 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:12.657783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-be683aeb-95df-4b33-ac7e-8870b7ab5e98 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.153017 Jul 27 08:57:12.658387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 578/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:12 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:13.679843 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:13.680471 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:13.686989 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:13.687435 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:13.688914 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:13.689335 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:13.815928 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:13.823502 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-839fd593-6c8c-46d5-a8f3-6b91ed714e71 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.147538 Jul 27 08:57:13.824055 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 585/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:13 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:14.845252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:14.845853 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:14.852558 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:14.853006 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:14.853798 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:14.854254 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:14.971286 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=2 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:14.989418 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:14.996783 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-f639c3cc-4d8b-4010-8c16-47d5420cb694 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.156267 Jul 27 08:57:14.997343 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 579/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:14 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:16.021556 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:16.024102 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:16.024754 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell0:SELECT=2 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:16.029825 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:16.030314 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:16.031087 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:16.031553 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:16.181908 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:16.191632 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-e4b9a0fc-e488-49f3-a26d-02cb5a098948 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.174075 Jul 27 08:57:16.192215 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 586/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:16 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:17.213458 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:17.214034 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:17.216201 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell0:SELECT=6 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:17.222977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:17.223428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:17.224223 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:17.224660 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:17.362208 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:17.369904 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-0a1c1cfc-5e00-489e-9667-27b9ebd70af6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.160703 Jul 27 08:57:17.370502 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 580/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:17 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:18.391897 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:18.392655 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:18.399226 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:18.399700 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:18.400446 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:18.400880 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:18.540221 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:18.548559 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-28cb503f-dd86-470b-b78c-035e9aafabad tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.161286 Jul 27 08:57:18.549147 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 587/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:18 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:19.574636 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:19.575753 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:19.583333 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:19.583788 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:19.584814 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:19.585260 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:19.757515 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:19.767977 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-af770237-5fdb-4173-85b4-2ef05dd8baf9 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.198581 Jul 27 08:57:19.768747 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 581/1168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:19 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:20.789421 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:20.790044 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:20.796672 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:20.797365 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:20.798174 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:20.798598 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:20.946487 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:20.954077 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-8191e239-9001-4ba2-a449-a2a88a9a1a86 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.168149 Jul 27 08:57:20.954670 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 588/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:20 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:21.094772 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-8ff0bd6c-56b3-4933-b663-cc8b23a61d7a req-dc1f5183-333c-48e5-a134-a19cfc516ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff87149-f6c9-4853-83a9-85f651545441", "name": "network-vif-plugged", "status": "completed", "tag": "23c5071b-889a-4075-bf12-2f7ef7f23fef"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:21.104116 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-8ff0bd6c-56b3-4933-b663-cc8b23a61d7a req-dc1f5183-333c-48e5-a134-a19cfc516ed3 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:21.106477 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-8ff0bd6c-56b3-4933-b663-cc8b23a61d7a req-dc1f5183-333c-48e5-a134-a19cfc516ed3 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:21.115217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-8ff0bd6c-56b3-4933-b663-cc8b23a61d7a req-dc1f5183-333c-48e5-a134-a19cfc516ed3 service nova] Creating event network-vif-plugged:23c5071b-889a-4075-bf12-2f7ef7f23fef for instance bff87149-f6c9-4853-83a9-85f651545441 on hv-cinder-85117 Jul 27 08:57:21.120328 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-8ff0bd6c-56b3-4933-b663-cc8b23a61d7a req-dc1f5183-333c-48e5-a134-a19cfc516ed3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163386 Jul 27 08:57:21.120902 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 582/1170] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:57:21.975695 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:21.977282 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:21.985646 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:21.986101 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:21.986921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:21.987972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:22.135826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:22.146352 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3241c83d-89b2-4393-9d7b-0aa7d290d5d0 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.174535 Jul 27 08:57:22.146954 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 589/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:21 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:23.169257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:23.169858 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:23.176507 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:23.176957 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:23.177893 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:23.178366 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:23.320390 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:23.329387 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-ac4c8937-5801-413f-9dbb-3c1001cf6928 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1266 microversion: 2.1 time: 0.164825 Jul 27 08:57:23.329982 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 583/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:23 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:24.351330 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:24.351958 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:24.358405 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:24.358851 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:24.359684 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:24.360112 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:24.497693 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:24.506205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-05691dbc-d046-49f4-9f33-400ea1eb9dce tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1453 microversion: 2.1 time: 0.158913 Jul 27 08:57:24.506797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 590/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:24 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:24.527295 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:57:24.527896 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:57:24.534700 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:24.535144 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:24.535928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:24.536397 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:24.681041 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:57:24.690318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-d61b1221-03b9-4206-af37-45d1326ef614 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1453 microversion: 2.1 time: 0.165555 Jul 27 08:57:24.690318 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 584/1174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:57:24 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:57:27.098657 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-671b3c6b-ce6e-4341-990c-adf26032d739 req-ade49694-4b76-4963-9400-4f0e7cb714e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff87149-f6c9-4853-83a9-85f651545441", "tag": "23c5071b-889a-4075-bf12-2f7ef7f23fef"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:57:27.108367 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-671b3c6b-ce6e-4341-990c-adf26032d739 req-ade49694-4b76-4963-9400-4f0e7cb714e8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:57:27.108807 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-671b3c6b-ce6e-4341-990c-adf26032d739 req-ade49694-4b76-4963-9400-4f0e7cb714e8 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:57:27.120973 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-671b3c6b-ce6e-4341-990c-adf26032d739 req-ade49694-4b76-4963-9400-4f0e7cb714e8 service nova] Creating event network-changed:23c5071b-889a-4075-bf12-2f7ef7f23fef for instance bff87149-f6c9-4853-83a9-85f651545441 on hv-cinder-85117 Jul 27 08:57:27.126727 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-671b3c6b-ce6e-4341-990c-adf26032d739 req-ade49694-4b76-4963-9400-4f0e7cb714e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098475 Jul 27 08:57:27.127348 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 591/1175] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:57:50.854369 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:57:50.855188 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 08:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:58:12.701990 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:58:12.702735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 08:58:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:59:15.054909 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:15.056018 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG dbcounter [-] [129924] Writing DB stats nova_cell1:SELECT=58 {{(pid=129924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:15.056552 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_api:SELECT=24 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:15.058018 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG dbcounter [-] [129921] Writing DB stats nova_cell1:SELECT=52 {{(pid=129921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:15.060235 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:15.060966 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:15.062824 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-913d05bc-3ea1-49f8-9bd0-3d87171b62cb req-86c2032d-80b0-47ef-8f14-8d3535d50af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff87149-f6c9-4853-83a9-85f651545441", "tag": "23c5071b-889a-4075-bf12-2f7ef7f23fef"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:59:15.070257 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:15.070746 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:15.071662 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:15.072101 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:15.075738 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-913d05bc-3ea1-49f8-9bd0-3d87171b62cb req-86c2032d-80b0-47ef-8f14-8d3535d50af6 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:15.076950 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-913d05bc-3ea1-49f8-9bd0-3d87171b62cb req-86c2032d-80b0-47ef-8f14-8d3535d50af6 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:15.090279 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-913d05bc-3ea1-49f8-9bd0-3d87171b62cb req-86c2032d-80b0-47ef-8f14-8d3535d50af6 service nova] Creating event network-changed:23c5071b-889a-4075-bf12-2f7ef7f23fef for instance bff87149-f6c9-4853-83a9-85f651545441 on hv-cinder-85117 Jul 27 08:59:15.099607 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-913d05bc-3ea1-49f8-9bd0-3d87171b62cb req-86c2032d-80b0-47ef-8f14-8d3535d50af6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044582 Jul 27 08:59:15.100323 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 592/1176] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:59:15.101353 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:59:15.402857 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-69e494bf-bc07-466d-8811-abd26c973146 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 204 len: 0 microversion: 2.1 time: 0.350841 Jul 27 08:59:15.407533 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 585/1177] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:59:15 2022] DELETE /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:59:15.415864 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:15.416826 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:15.425065 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:15.425792 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:15.426322 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:15.426795 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:15.568701 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:15.577178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ffc82087-d908-4755-9a54-26647be484c6 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1577 microversion: 2.1 time: 0.167956 Jul 27 08:59:15.577755 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 593/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:15 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:16.600614 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:16.601316 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:16.608384 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:16.608831 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:16.609607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:16.610033 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:16.772129 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:16.780213 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-c2fbf5a9-0ffd-4262-8aba-9d9e69dc23ea tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1577 microversion: 2.1 time: 0.183948 Jul 27 08:59:16.780777 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 586/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:16 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:17.800785 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:17.801389 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:17.802703 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [req-84a92152-2443-46cb-8d28-eb7bef561f56 req-a8927d87-d9d2-4fa7-8680-8e83fd12c9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff87149-f6c9-4853-83a9-85f651545441", "name": "network-vif-deleted", "tag": "23c5071b-889a-4075-bf12-2f7ef7f23fef"}]} {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:59:17.808155 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:17.815076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:17.815076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:17.815076 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:17.815443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-84a92152-2443-46cb-8d28-eb7bef561f56 req-a8927d87-d9d2-4fa7-8680-8e83fd12c9c6 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:17.815443 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [req-84a92152-2443-46cb-8d28-eb7bef561f56 req-a8927d87-d9d2-4fa7-8680-8e83fd12c9c6 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:17.828623 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.compute.server_external_events [req-84a92152-2443-46cb-8d28-eb7bef561f56 req-a8927d87-d9d2-4fa7-8680-8e83fd12c9c6 service nova] Creating event network-vif-deleted:23c5071b-889a-4075-bf12-2f7ef7f23fef for instance bff87149-f6c9-4853-83a9-85f651545441 on hv-cinder-85117 Jul 27 08:59:17.836341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [req-84a92152-2443-46cb-8d28-eb7bef561f56 req-a8927d87-d9d2-4fa7-8680-8e83fd12c9c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036685 Jul 27 08:59:17.836341 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 587/1180] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:59:17.887402 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:17.895482 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-77b754b6-056d-44f4-99e3-303821930d8f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1391 microversion: 2.1 time: 0.098531 Jul 27 08:59:17.896628 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 594/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:17 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1391 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:18.917701 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:18.918463 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:18.925236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:18.925691 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:18.926495 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:18.926928 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:18.959735 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:18.960177 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:18.960622 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.objects.instance [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lazy-loading 'fault' on Instance uuid bff87149-f6c9-4853-83a9-85f651545441 {{(pid=129924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:59:19.011000 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:19.018799 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-fa72fbcc-b059-4d82-899a-7db1b25d5adb tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 200 len: 1230 microversion: 2.1 time: 0.105480 Jul 27 08:59:19.019361 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 588/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:18 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:20.047189 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:20.047802 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: bff87149-f6c9-4853-83a9-85f651545441] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:20.055319 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:20.055841 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:20.056744 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:20.057216 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:20.075830 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] HTTP exception thrown: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Request method failure captured: Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 HTTP/1.1 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PxREko5ZpON8G0lPUJb2ruuFPQfmCkimnBOy_rf-fFoEpEkFoL0tMpp5bcDIAkuM-QZogmaH8nqZZpXDESiu2NFgHYSc8_DESEJkn3Loy7Kx1EpaPv2LpXcjmBy0gkTySiG_H-pt1T8AmlRD_LfH6vYcHU5qusIxui7aPonGrDX-Uw Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:59:20.077525 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e664288b45ae4b98ae22270ea7eac1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 3023e29a392a4d97acbb11faecc0c9b8 Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. Jul 27 08:59:20.080477 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': 'bff87149-f6c9-4853-83a9-85f651545441'} Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:59:20.081662 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. Jul 27 08:59:20.083508 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:20.085205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Returning 404 to user: Instance bff87149-f6c9-4853-83a9-85f651545441 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:59:20.085205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-1a8ee9e3-a441-442c-9ccb-37eeeac81a3d tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441" status: 404 len: 111 microversion: 2.1 time: 0.035780 Jul 27 08:59:20.085205 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 595/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:20 2022] GET /compute/v2.1/servers/bff87149-f6c9-4853-83a9-85f651545441 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:59:23.504523 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:23.505086 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:23.507705 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-ceeb2d3c-f671-45e2-853d-08b36674524c req-60c5e378-5aea-4345-bcfc-31483bd97ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0de859b-72e8-4dc0-9af8-8c63b431ac4e", "tag": "7542cc58-529d-46b1-92a1-0856e0cf8843"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:59:23.512674 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:23.513127 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:23.513960 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:23.514428 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:23.518760 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ceeb2d3c-f671-45e2-853d-08b36674524c req-60c5e378-5aea-4345-bcfc-31483bd97ee9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:23.519270 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-ceeb2d3c-f671-45e2-853d-08b36674524c req-60c5e378-5aea-4345-bcfc-31483bd97ee9 service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:23.533786 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-ceeb2d3c-f671-45e2-853d-08b36674524c req-60c5e378-5aea-4345-bcfc-31483bd97ee9 service nova] Creating event network-changed:7542cc58-529d-46b1-92a1-0856e0cf8843 for instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e on hv-cinder-85117 Jul 27 08:59:23.540492 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-ceeb2d3c-f671-45e2-853d-08b36674524c req-60c5e378-5aea-4345-bcfc-31483bd97ee9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037871 Jul 27 08:59:23.541998 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 596/1184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:59:23.550352 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Going to try to terminate instance {{(pid=129924) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:59:23.893217 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-987e1c5d-8482-41c2-a1fb-791cfe2c0304 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 204 len: 0 microversion: 2.1 time: 0.392657 Jul 27 08:59:23.894077 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 589/1185] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:59:23 2022] DELETE /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:59:23.908921 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:23.909900 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:23.920130 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:23.922325 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:23.924429 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:23.925114 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:24.084959 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:24.093455 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-942ce42e-7c19-4326-a842-4ca303c45575 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1577 microversion: 2.1 time: 0.191947 Jul 27 08:59:24.094157 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 597/1186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:23 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:25.116828 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:25.117505 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:25.124457 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:25.126578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:25.126578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:25.126578 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:25.267155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:25.275055 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-6f65b525-b9a5-4415-889d-0f90f153b5ec tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1577 microversion: 2.1 time: 0.163145 Jul 27 08:59:25.275630 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 590/1187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:25 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:26.158740 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [req-f3e0a15b-6d44-44d3-8336-2ca17b126048 req-1aad435f-6fd8-4f62-b935-be0949d201ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0de859b-72e8-4dc0-9af8-8c63b431ac4e", "name": "network-vif-deleted", "tag": "7542cc58-529d-46b1-92a1-0856e0cf8843"}]} {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:59:26.168712 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f3e0a15b-6d44-44d3-8336-2ca17b126048 req-1aad435f-6fd8-4f62-b935-be0949d201ff service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:26.169152 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [req-f3e0a15b-6d44-44d3-8336-2ca17b126048 req-1aad435f-6fd8-4f62-b935-be0949d201ff service nova] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:26.180515 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.compute.server_external_events [req-f3e0a15b-6d44-44d3-8336-2ca17b126048 req-1aad435f-6fd8-4f62-b935-be0949d201ff service nova] Creating event network-vif-deleted:7542cc58-529d-46b1-92a1-0856e0cf8843 for instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e on hv-cinder-85117 Jul 27 08:59:26.185941 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [req-f3e0a15b-6d44-44d3-8336-2ca17b126048 req-1aad435f-6fd8-4f62-b935-be0949d201ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031136 Jul 27 08:59:26.186894 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 598/1188] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Jul 27 08:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:59:26.297566 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:26.298274 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:26.305936 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:26.306424 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:26.307279 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:26.307720 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:26.377088 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.policy [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129924) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:26.385640 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-504f987d-c775-4ef8-9f90-f40580205965 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1224 microversion: 2.1 time: 0.091940 Jul 27 08:59:26.386236 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 591/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:26 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:59:27.408151 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:27.408878 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:27.415995 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:27.422108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:27.422108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:27.422108 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:27.452075 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:27.452522 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:27.452972 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.objects.instance [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lazy-loading 'fault' on Instance uuid b0de859b-72e8-4dc0-9af8-8c63b431ac4e {{(pid=129921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:59:27.500463 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.policy [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3023e29a392a4d97acbb11faecc0c9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664288b45ae4b98ae22270ea7eac1e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129921) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:59:27.509031 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-ba09e98c-6a53-4766-987f-39a4f56d601a tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 200 len: 1229 microversion: 2.1 time: 0.105613 Jul 27 08:59:27.509767 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 599/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:27 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:59:28.533597 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:28.534437 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: b0de859b-72e8-4dc0-9af8-8c63b431ac4e] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:28.541833 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:28.542329 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:28.543155 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:28.543594 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:28.563229 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] HTTP exception thrown: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Request method failure captured: Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e HTTP/1.1 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PxREko5ZpON8G0lPUJb2ruuFPQfmCkimnBOy_rf-fFoEpEkFoL0tMpp5bcDIAkuM-QZogmaH8nqZZpXDESiu2NFgHYSc8_DESEJkn3Loy7Kx1EpaPv2LpXcjmBy0gkTySiG_H-pt1T8AmlRD_LfH6vYcHU5qusIxui7aPonGrDX-Uw Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:59:28.564888 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e664288b45ae4b98ae22270ea7eac1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 3023e29a392a4d97acbb11faecc0c9b8 Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. Jul 27 08:59:28.567976 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': 'b0de859b-72e8-4dc0-9af8-8c63b431ac4e'} Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:59:28.569214 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. Jul 27 08:59:28.572252 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:28.574308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Returning 404 to user: Instance b0de859b-72e8-4dc0-9af8-8c63b431ac4e could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:59:28.574308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-17db4062-ae72-4b99-a587-245161099432 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e" status: 404 len: 111 microversion: 2.1 time: 0.039022 Jul 27 08:59:28.574308 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 592/1191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:28 2022] GET /compute/v2.1/servers/b0de859b-72e8-4dc0-9af8-8c63b431ac4e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:59:29.122040 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:29.122642 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.compute.api [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129921) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:29.129178 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:29.129621 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:29.130434 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:29.130877 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG oslo_concurrency.lockutils [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:29.146184 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.wsgi [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] HTTP exception thrown: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Request method failure captured: Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: request: DELETE /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 HTTP/1.1 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept: application/json Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Accept-Encoding: identity Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Connection: close Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Length: 0 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Content-Type: application/json Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Host: 10.222.0.40 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Openstack-System-Scope: None Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: User-Agent: python-urllib3/1.26.10 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Auth-Token: gAAAAABi4PxREko5ZpON8G0lPUJb2ruuFPQfmCkimnBOy_rf-fFoEpEkFoL0tMpp5bcDIAkuM-QZogmaH8nqZZpXDESiu2NFgHYSc8_DESEJkn3Loy7Kx1EpaPv2LpXcjmBy0gkTySiG_H-pt1T8AmlRD_LfH6vYcHU5qusIxui7aPonGrDX-Uw Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Id: None Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Domain-Name: None Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Identity-Status: Confirmed Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Is-Admin-Project: True Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Id: default Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Domain-Name: Default Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Project-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Role: member,reader Jul 27 08:59:29.147853 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Roles: member,reader Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e664288b45ae4b98ae22270ea7eac1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-Tenant-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Id: default Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Domain-Name: Default Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Id: 3023e29a392a4d97acbb11faecc0c9b8 Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: X-User-Name: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: method: > Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: exception: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.150631 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: action_args: {'id': '4c216ccb-efc3-469c-b23e-31364c82cb45'} Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:59:29.151634 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.153356 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.155357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Returning 404 to user: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. {{(pid=129921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:59:29.155357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-24e3e4e0-62d1-4b3f-84cf-4f9abab6c3c4 tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 404 len: 111 microversion: 2.1 time: 0.031867 Jul 27 08:59:29.155357 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 600/1192] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Jul 27 08:59:29 2022] DELETE /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:59:29.158665 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '>' {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:29.159301 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.compute.api [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] [instance: 4c216ccb-efc3-469c-b23e-31364c82cb45] Fetching instance by UUID {{(pid=129924) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:59:29.165607 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:29.166060 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:29.166864 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:59:29.167298 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG oslo_concurrency.lockutils [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Lock "a22975f3-3279-4eca-bf91-9724b46678bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:59:29.182431 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.wsgi [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] HTTP exception thrown: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Request method failure captured: Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: request: GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 HTTP/1.1 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept: application/json Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Accept-Encoding: identity Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Connection: close Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Length: 0 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Content-Type: application/json Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Host: 10.222.0.40 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Openstack-System-Scope: None Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: User-Agent: python-urllib3/1.26.10 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Auth-Token: gAAAAABi4PxREko5ZpON8G0lPUJb2ruuFPQfmCkimnBOy_rf-fFoEpEkFoL0tMpp5bcDIAkuM-QZogmaH8nqZZpXDESiu2NFgHYSc8_DESEJkn3Loy7Kx1EpaPv2LpXcjmBy0gkTySiG_H-pt1T8AmlRD_LfH6vYcHU5qusIxui7aPonGrDX-Uw Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Id: None Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Domain-Name: None Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Identity-Status: Confirmed Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Is-Admin-Project: True Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Id: default Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Domain-Name: Default Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Project-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Role: member,reader Jul 27 08:59:29.183986 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Roles: member,reader Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e664288b45ae4b98ae22270ea7eac1e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e664288b45ae4b98ae22270ea7eac1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Id: e664288b45ae4b98ae22270ea7eac1e6 Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-Tenant-Name: tempest-TestVolumeBootPattern-281247421 Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Id: default Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Domain-Name: Default Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Id: 3023e29a392a4d97acbb11faecc0c9b8 Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: X-User-Name: tempest-TestVolumeBootPattern-281247421-project Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: method: > Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: exception: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.185574 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: action_args: {'id': '4c216ccb-efc3-469c-b23e-31364c82cb45'} Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: {{(pid=129924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:59:29.186492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. Jul 27 08:59:29.187844 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: ERROR nova.api.openstack.wsgi Jul 27 08:59:29.189081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: DEBUG nova.api.openstack.wsgi [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Returning 404 to user: Instance 4c216ccb-efc3-469c-b23e-31364c82cb45 could not be found. {{(pid=129924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:59:29.189081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO nova.api.openstack.requestlog [None req-3c1a03da-157b-432a-af5f-19ff2e1db1ee tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45" status: 404 len: 111 microversion: 2.1 time: 0.030686 Jul 27 08:59:29.189081 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: [pid: 129924|app: 0|req: 593/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Jul 27 08:59:29 2022] GET /compute/v2.1/servers/4c216ccb-efc3-469c-b23e-31364c82cb45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:59:30.653542 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: DEBUG nova.api.openstack.wsgi [None req-3426dce8-b47d-40fd-b5b6-8f0f77a00a9f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] Calling method '.version_select at 0x7f78f10a23a0>' {{(pid=129921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:59:30.746328 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO nova.api.openstack.requestlog [None req-3426dce8-b47d-40fd-b5b6-8f0f77a00a9f tempest-TestVolumeBootPattern-281247421 tempest-TestVolumeBootPattern-281247421-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-403744077" status: 202 len: 0 microversion: 2.1 time: 0.097618 Jul 27 08:59:30.746943 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: [pid: 129921|app: 0|req: 601/1194] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Jul 27 08:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-403744077 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:59:38.361207 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:59:38.361787 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 08:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:59:40.926027 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:59:40.926660 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 08:59:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:01:32.710705 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:01:32.711342 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 09:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:02:58.370831 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:02:58.371492 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 09:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:03:00.936797 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:03:00.937440 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 09:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:04:30.867458 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:04:30.868228 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 09:04:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:04:52.718979 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:04:52.719522 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 09:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:04:53.934154 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:04:53.934852 dv-cinder-851170-2-iscsi devstack@n-api.service[129924]: Wed Jul 27 09:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 09:04:55.538746 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 09:04:55.539318 dv-cinder-851170-2-iscsi devstack@n-api.service[129921]: Wed Jul 27 09:04:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!